Senior AI Agent Engineer — Production Systems

Scale AI, Inc.; New York (NY); On-site; USD 265,000 - 331,000; Full time

Benefits offered by this job

Health benefits

Retirement plan

Learning stipend

Generous PTO

Commuter stipend

Job summary

Scale AI is hiring a Senior/Staff Machine Learning Engineer for the General Agents team to design, build and deploy production-ready AI agents that tackle high-impact enterprise problems at scale. You will bridge state-of-the-art agentic techniques with real customer environments across the full lifecycle.

You will collaborate with product managers, customers and other engineering teams to translate enterprise requirements into robust agent designs, production-grade code, and observable systems,

Qualifications

• 5+ years of experience building and deploying ML/AI systems.
• Bachelor's and/or Master's degree in CS/ML or equivalent practical experience.
• Deep understanding of modern LLMs, prompt optimization, and agentic design.
• Proficient in Python, including production-quality code.
• Experience integrating models with tools, APIs, databases, and services.
• Ability to operate in ambiguous problem spaces with pragmatic solutions.
• Strong communication and cross-functional collaboration.

Responsibilities

• Design end-to-end agent systems combining LLM reasoning, tool use, memory and control.
• Build scalable, reliable agent architectures for many customers.
• Develop evaluation frameworks, datasets, environments and metrics.
• Collaborate with product managers, customers and engineering teams.
• Productionize frontier agent techniques into maintainable systems.
• Own deployment, monitoring and iteration with real-world usage.
• Contribute to technical direction and architectural decisions at Staff level.

Skills

LLM systems design

Python

Agent development

Tool integration

Communication

Problem solving

Education

Bachelor's degree in CS/ML

Master's degree (preferred)

Tools

OpenAI APIs

Agent frameworks

Cloud platforms

Python (production)

Job description

Scale AI is hiring a Senior/Staff Machine Learning Engineer for the General Agents team to design, build and deploy production-ready AI agents that tackle high-impact enterprise problems at scale. You will bridge state-of-the-art agentic techniques with real customer environments across the full lifecycle.

You will collaborate with product managers, customers and other engineering teams to translate enterprise requirements into robust agent designs, production-grade code, and observable systems,