Hybrid AI Platform Engineer — LLM & AI Workflows

Harley Ellis Devereaux Corporation; San Diego (CA); Hybrid; USD 120.000 - 170.000; Vollzeit

Zusammenfassung

Harley Ellis Devereaux Corporation seeks an AI Platform Engineer to build and optimize production AI solutions, evaluate large language models, and transform organizational knowledge into secure, accessible intelligence. You will work within the Data & AI team to own defined initiatives and collaborate with developers, data engineers, and business stakeholders.

You'll help design workflows that capture employee expertise for AI-powered apps, develop data models and governance, and contribute to

Qualifikationen

• 4–6+ years in software/ML/data eng or related field.
• Hands-on experience deploying/ supporting LLM apps in production.
• Experience with AI evaluations, benchmarks, or performance testing.
• Knowledge of RAG, information retrieval, prompt engineering, and context optimization.
• Proficiency in Python and SQL, Git, automated testing, and modern dev practices.
• Experience with cloud apps, APIs, and data integration workflows.
• Understanding of enterprise data governance, privacy and security.
• Ability to deliver complex technical assignments and communicate with stakeholders.

Aufgaben

• Develop and maintain model benchmarking, datasets, and performance baselines for production AI apps.
• Evaluate models, prompts, configurations; document findings and improvements.
• Support preproduction validation of model, prompt, and app changes.
• Develop and optimize retrieval-augmented generation, ranking, prompts, and context management.
• Measure answer quality, token usage, and operating costs to guide improvements.
• Collaborate with app developers to improve shared AI capabilities and UX.
• Deliver defined AI use cases from requirements to implementation and adoption.
• Help design workflows to capture employee expertise for AI apps.
• Create structured data models, skills taxonomies, and knowledge capture workflows; partner with data engineering.
• Work with stakeholders to define requirements and success criteria.

Kenntnisse

Python

SQL

Git

LLM apps

AI evaluations

Cloud APIs

Data governance

Stakeholder comms

Ausbildung

Bachelor's degree in CS/Software Eng/Data Science

Equivalent practical experience

Tools

Azure OpenAI

Amazon Bedrock

Anthropic

Databricks

Delta Lake

Unity Catalog

MLflow

Jobbeschreibung

Harley Ellis Devereaux Corporation seeks an AI Platform Engineer to build and optimize production AI solutions, evaluate large language models, and transform organizational knowledge into secure, accessible intelligence. You will work within the Data & AI team to own defined initiatives and collaborate with developers, data engineers, and business stakeholders.

You'll help design workflows that capture employee expertise for AI-powered apps, develop data models and governance, and contribute to