AI Platform Engineer - Hybrid: Build Production AI Solutions

Harley Ellis Devereaux (HED); Sacramento (CA); Hybrid; USD 140,000 - 210,000; Full time

Job summary

Harley Ellis Devereaux seeks an AI Platform Engineer to build production AI capabilities, evaluate LLMs, and improve intelligent workflows across our practice. You will collaborate with data engineers, developers, and stakeholders to deliver secure, scalable AI solutions that empower teams and enhance outcomes.

Based in a hybrid California office, you will own defined technical initiatives, contribute to architectural decisions, and help grow platform leadership within the Data & AI group.

Qualifications

• Approximately 4-6+ years of experience in software engineering, ML engineering, data engineering, or a related technical discipline.
• Hands-on experience deploying, or supporting, LLM applications in production.
• Experience implementing AI evaluations, benchmarks, or performance testing.
• Working knowledge of RAG, information retrieval, prompt engineering, and context optimization.
• Proficiency in Python and SQL, Git, automated testing, and modern software development practices.
• Experience with cloud applications, APIs, and data integration workflows.
• Understanding of enterprise data governance, privacy, and security.
• Ability to independently deliver complex technical assignments and communicate effectively with technical and nontechnical stakeholders.

Responsibilities

• Develop and maintain model benchmarking, evaluation datasets, testing methods, and performance baselines across production AI applications.
• Evaluate models, prompts, and configurations against response quality, reliability, cost, latency, and risk; document findings and recommend improvements.
• Support preproduction validation of model, prompt, and application changes.
• Develop and optimize retrieval-augmented generation (RAG), retrieval ranking, prompt structures, context management, and caching.
• Measure answer quality, token usage, and operating costs; use results to guide improvements.
• Collaborate with application developers to improve shared AI capabilities and user experiences.
• Deliver defined AI use cases from requirements and design through implementation, testing, documentation, adoption, and improvement.
• Work with business stakeholders to define requirements, success criteria, and practical solutions.

Skills

Python

SQL

LLM evaluation

RAG

Prompt engineering

CI/CD

Cloud APIs

Data governance

Communications

Education

Bachelor's degree in Computer Science or related field

Tools

Azure OpenAI

Databricks

MLflow

Unity Catalog

Job description

Harley Ellis Devereaux seeks an AI Platform Engineer to build production AI capabilities, evaluate LLMs, and improve intelligent workflows across our practice. You will collaborate with data engineers, developers, and stakeholders to deliver secure, scalable AI solutions that empower teams and enhance outcomes.

Based in a hybrid California office, you will own defined technical initiatives, contribute to architectural decisions, and help grow platform leadership within the Data & AI group.