AI Platform Engineer - Search/LLMs/Q&A

Motion Recruitment; Orlando (FL); On-site; USD 112,963 - 121,228; Full time

Benefits offered by this job

Medical Insurance

Health Savings Account

Voluntary Life Insurance

Flexible Spending Accounts

Job summary

A major entertainment and technology provider is seeking an AI Platform Engineer for their AI enablement team. This hybrid position in Orlando, FL, involves enhancing AI-driven search solutions, working with advanced programming in Java and Python, and engaging with multi-team efforts. Ideal candidates have expertise in search technologies, prompt engineering, and AI observability, with a strong focus on operational excellence. A bachelor's degree or equivalent experience is required. This 10-month contract includes competitive benefits and potential for extension.

Qualifications

• Advanced programming skills in Java and Python.
• Direct experience with search technology stacks.
• Results-oriented mindset with ability to manage shifting priorities.

Responsibilities

• Partner with product teams to design experiments.
• Build and refine tools for content gap detection.
• Define and track performance indicators.

Skills

Java programming

Python programming

Search technology stacks

Prompt engineering

A/B testing

AI observability

CI/CD processes

Cross-team coordination

Education

Bachelor’s degree in Computer Science or related field

Tools

Google Cloud (Vertex AI)

Elasticsearch

Grafana

Job description

This range is provided by Motion Recruitment. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$82.00/hr - $88.00/hr

One of the country’s largest entertainment and technology providers is searching for a skilled AI Platform Engineer to join their AI enablement team on a hybrid basis in Orlando, FL. In this impactful role, you’ll act as the critical bridge between product operations and engineering, creating world‑class AI evaluation tools, automating content analysis, and ensuring guests and team members receive outstanding, reliable answers from their new AI‑powered Q/A search tool, which you will help develop. If you want to build solutions that enable state‑of‑the‑art search, prompt tuning, and continuous quality improvements in a hyper‑dynamic environment, this is your chance to make an immediate difference.

This exciting opportunity launches as a 10‑month W2 contract offering competitive benefits, a hybrid work schedule, and strong potential for extension or conversion.

Please Note: This position cannot support C2C or offer sponsorship/transfer of any visas.

Responsibilities

• Partner with product teams to design and run experiments that enhance models, prompts, content aggregation, retrieval logic, and automated protections, tracking key metrics with advanced observability platforms.
• Build and refine tools for detecting content gaps, diagnosing retrieval issues, and evaluating and tuning prompts, ensuring the platform delivers consistently high‑quality answers.
• Define, track, and report on critical performance indicators like answer precision/recall, relevance, accuracy, and latency, maintaining robust dashboards for ongoing monitoring.
• Investigate and resolve search platform and answer quality issues, collaborating across engineering, content, and operations to tackle bugs, configuration challenges, and gaps.
• Lead root cause analysis for incidents, implement or coordinate fixes across teams, and institute systematic improvements to boost relevance, quality, and reliability.
• Own triage and hypercare after new releases: coordinate issue logging, prioritization, resolution, and clear communications with service levels in mind.
• Document solutions, create runbooks and playbooks, and establish repeatable processes for rapid troubleshooting, experimentation, and operational excellence.

Skills & Experience

• Bachelor’s degree in Computer Science or a related field (or 15+ years equivalent experience)
• Advanced programming skills in Java and Python, especially for building back‑end services, APIs, and workflow automation
• Direct experience with search technology stacks and Retrieval‑Augmented Generation (RAG), including vector embeddings and prompt engineering
• Mastery in diagnosing and resolving cross‑stack issues—ability to pinpoint root causes in data flows, retrieval methods, prompt logic, and back‑end code
• Hands‑on experimentation skills: A/B testing, metric definition, analysis, and application of findings to production AI systems
• Familiarity with AI observability, drift detection, and monitoring using leading industry tools
• Proven track record coordinating multi‑team engineering efforts, driving solutions in partnership with product operations, and communicating clearly across stakeholders
• Experience with CI/CD processes, version control, automated testing frameworks, and feature flag management
• Results‑oriented mindset with the ability to rapidly manage shifting priorities and see solutions through from detection to closure

Preferred Experience

• Exposure to agentic AI design (complex workflow orchestration, automated actions)
• Hands‑on work with Google Cloud (especially Vertex AI), Elasticsearch/OpenSearch/Lucene, vector databases, reranking, and embedding models
• Familiarity with tools like AppDynamics, Splunk, Grafana, and Arize for observability and analytics
• Understanding of Responsible AI practices, content governance, and rigorous guardrail implementation

Benefits

• Medical Insurance - Four medical plans to choose from for you and your family
• Health Savings Account (HSA)
• Health and Dependent Care Flexible Spending Accounts
• Voluntary Life Insurance, Long‑Term & Short‑Term Disability Insurance
• Hospital Indemnity Insurance
• Legal and Identity Protection Plans
• 529 College Saver Plan

Motion Recruitment Partners is an Equal Opportunity Employer, including disability/vets. All applicants must be currently authorized to work on a full‑time basis in the country for which they are applying, and no sponsorship is currently available. Employment is subject to the successful completion of a pre‑employment screening. Accommodation will be provided in all parts of the hiring process as required under Motion Recruitment Employment Accommodation policy.