Hybrid AI Platform Engineer - Production ML & RAG

Harley Ellis Devereaux (HED); San Francisco (CA); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Harley Ellis Devereaux (HED) is seeking an AI Platform Engineer to design, implement, and optimize production AI capabilities that empower our teams. You will evaluate large language models, refine AI-generated responses, and transform organizational knowledge into secure, accessible intelligence.

You will work within the Data & AI team to own technical initiatives, collaborate with developers and business stakeholders, and influence platform leadership potential while upholding governance and

Qualifications

• Approximately 4-6+ years of experience in software engineering, ML engineering, data engineering, or related field.
• Hands-on experience deploying or supporting LLM applications in production.
• Experience implementing AI evaluations, benchmarks, or performance testing.
• Working knowledge of RAG, information retrieval, prompt engineering, and context optimization.

Responsibilities

• Develop and maintain production AI solutions and model benchmarking datasets.
• Evaluate models, prompts, and configurations for quality, cost, latency, and risk.
• Collaborate with engineers to improve AI capabilities and user experiences.
• Deliver defined AI use cases from requirements through implementation and adoption.

Skills

Python

SQL

Git

CI/CD

LLM concepts

Education

Bachelor’s degree

Tools

Azure OpenAI

Bedrock

Anthropic

Databricks

Delta Lake

MLflow

Job description

Harley Ellis Devereaux (HED) is seeking an AI Platform Engineer to design, implement, and optimize production AI capabilities that empower our teams. You will evaluate large language models, refine AI-generated responses, and transform organizational knowledge into secure, accessible intelligence.

You will work within the Data & AI team to own technical initiatives, collaborate with developers and business stakeholders, and influence platform leadership potential while upholding governance and