AI Platform Engineer

One of the country’s largest entertainment and technology providers is searching for a skilled AI Platform Engineer to join their AI enablement team on a hybrid basis in Orlando, FL. In this impactful role, you’ll act as the critical bridge between product operations and engineering, creating world-class AI evaluation tools, automating content analysis, and ensuring guests and team members receive outstanding, reliable answers from an AI-powered platform. If you want to build solutions that enable state-of-the-art search, prompt tuning, and continuous quality improvements in a hyper-dynamic environment, this is your chance to make an immediate difference.

This exciting opportunity launches as a 10-month W2 contract offering competitive benefits, a hybrid work schedule, and strong potential for extension or conversion.

Please Note: This position cannot support C2C or offer sponsorship/transfer of any visas.

Responsibilities:

• Partner with product teams to design and run experiments that enhance models, prompts, content aggregation, retrieval logic, and automated protections, tracking key metrics with advanced observability platforms.
• Build and refine tools for detecting content gaps, diagnosing retrieval issues, and evaluating and tuning prompts, ensuring the platform delivers consistently high-quality answers.
• Define, track, and report on critical performance indicators like answer precision/recall, relevance, accuracy, and latency, maintaining robust dashboards for ongoing monitoring.
• Investigate and resolve search platform and answer quality issues, collaborating across engineering, content, and operations to tackle bugs, configuration challenges, and gaps.
• Lead root cause analysis for incidents, implement or coordinate fixes across teams, and institute systematic improvements to boost relevance, quality, and reliability.
• Own triage and hypercare after new releases: coordinate issue logging, prioritization, resolution, and clear communications with service levels in mind.
• Document solutions, create runbooks and playbooks, and establish repeatable processes for rapid troubleshooting, experimentation, and operational excellence.

Skills & Experience:

• Bachelor’s degree in Computer Science or a related field (or 15 years equivalent experience)
• Advanced programming skills in Java and Python, especially for building back-end services, APIs, and workflow automation
• Direct experience with search technology stacks and Retrieval-Augmented Generation (RAG), including vector embeddings and prompt engineering
• Mastery in diagnosing and resolving cross-stack issues—ability to pinpoint root causes in data flows, retrieval methods, prompt logic, and back-end code
• Hands-on experimentation skills: A/B testing, metric definition, analysis, and application of findings to production AI systems
• Familiarity with AI observability, drift detection, and monitoring using leading industry tools
• Proven track record coordinating multi-team engineering efforts, driving solutions in partnership with product operations, and communicating clearly across stakeholders
• Experience with CI/CD processes, version control, automated testing frameworks, and feature flag management
• Results-oriented mindset with the ability to rapidly manage shifting priorities and see solutions through from detection to closure

Preferred Experience:

• Exposure to agentic AI design (complex workflow orchestration, automated actions)
• Hands-on work with Google Cloud (especially Vertex AI), Elasticsearch/OpenSearch/Lucene, vector databases, reranking, and embedding models
• Familiarity with tools like AppDynamics, Splunk, Grafana, and Arize for observability and analytics
• Understanding of Responsible AI practices, content governance, and rigorous guardrail implementation

You will receive the following benefits:

• Medical Insurance - Four medical plans to choose from for you and your family
• Dental & Orthodontia Benefits
• Vision Benefits
• Health Savings Account (HSA)
• Health and Dependent Care Flexible Spending Accounts
• Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance
• Hospital Indemnity Insurance
• Paid Sick Time Leave
• Legal and Identity Protection Plans
• Pre-tax Commuter Benefit
• 529 College Saver Plan

Motion Recruitment Partners is an Equal Opportunity Employer, including disability/vets. All applicants must be currently authorized to work on a full-time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre-employment screening. Accommodation will be provided in all parts of the hiring process as required under Motion Recruitment Employment Accommodation policy. Applicants need to make their needs known in advance.