Senior ML Engineer: Agentic AI & LLM Systems

Aimlroles; Northern (KY); Hybrid; USD 205,000 - 270,000; Full time

Benefits offered by this job

Comprehensive medical, dental, and vis

Flexible PTO

Paid parental leave

Retirement savings plan

Remote work setup budget

Wellness stipend

In-office meal program

Job summary

Cresta is seeking a Machine Learning Engineer to design and deploy next-generation AI Agents and Agentic Assist systems. You will shape architecture, implement multi-step agent workflows, and optimize RAG pipelines for real-time use in production.

Ideal candidates have 5–8+ years building ML systems with LLMs, deep NLP expertise, and hands-on experience with PyTorch, TensorFlow, and Hugging Face in scalable environments. Remote-friendly role with strong growth opportunities.

Qualifications

• 5-8+ years building ML systems in production.
• Significant experience with LLMs in enterprise.
• Strong NLP, transformer, embeddings expertise.
• Experience designing RAG systems in production.
• Experience building and evaluating agentic LLM workflows.
• Knowledge of ML frameworks and distributed/cloud infra.
• Strong technical leadership and cross-functional influence.

Responsibilities

• Lead the design and development of next-generation AI Agents and Agentic Assist systems.
• Architect intelligent, multi-step agent workflows with real-time guidance and retrieval.
• Design, deploy, and optimize LLM-powered systems and RAG pipelines.
• Improve reasoning, planning, and tool-use in real-world AI apps.
• Develop evaluation strategies for complex, non-deterministic systems.
• Diagnose and mitigate failure modes like hallucinations and prompts brittleness.
• Define and measure quality metrics to improve reliability and cost.
• Collaborate with product, frontend, and backend teams to integrate AI capabilities.

Skills

LLMs

NLP

Agentic AI

Multi-step AI

Systems design

Education

Bachelor’s in CS or math

Master’s or PhD preferred

Tools

PyTorch

TensorFlow

Hugging Face

Cloud platforms

Job description

Cresta is seeking a Machine Learning Engineer to design and deploy next-generation AI Agents and Agentic Assist systems. You will shape architecture, implement multi-step agent workflows, and optimize RAG pipelines for real-time use in production.

Ideal candidates have 5–8+ years building ML systems with LLMs, deep NLP expertise, and hands-on experience with PyTorch, TensorFlow, and Hugging Face in scalable environments. Remote-friendly role with strong growth opportunities.