Engineering Manager, Agent Oversight & Production Platform

Scale AI; San Francisco, New York (CA, NY); On-site; USD 200,000 - 280,000; Full time

Job summary

Scale AI is seeking an Engineering Manager for Agent Oversight in a on-site role based in San Francisco, CA, with collaboration across New York. You will lead software and ML engineers, guiding the development of a platform to monitor, evaluate, and improve agentic applications for enterprise and government customers.

You will own the roadmap for deployment, monitoring, evaluation, and ML-driven improvements, work with product and FDE teams, and drive end-to-end delivery while fostering a

Qualifications

• 7+ years of engineering experience, including 2+ years directly managing engineers or ML engineers responsible for a production ML/LLM-powered system — not just consuming a third-party ML API within a feature
• Hands-on familiarity with agent architectures — tool use, planning, multi-agent orchestration — and the technical depth to make informed tradeoffs with your team
• Track record owning the full lifecycle of platform-level infrastructure — from initial design through scaling it across multiple internal or external teams as usage, headcount, and complexity grow
• Experience collaborating with product managers, forward deployed engineering (FDE) teams, and customers to translate real-world requirements into prioritization decisions and shipped platform capabilities
• Track record of building and growing high-performing engineering teams — including hiring, retention, or measurable improvements in team output or velocity
• Nice To Haves: Experience building or overseeing evaluation, monitoring, or observability systems for ML/LLM-powered products in production

Responsibilities

• Lead a multi-disciplinary team of software and ML engineers to drive technical delivery across Scale Generative AI Platform (SGP)
• Own the platform's roadmap across deployment, monitoring, evaluation, and ML-driven improvement of agentic applications
• Work cross-functionally with customers, forward deployed teams, product, and internal engineering teams to translate enterprise and government requirements into platform capabilities
• Build and ship features end-to-end, from system design through debugging and testing
• Drive high-velocity experimentation to validate and improve platform capabilities based on real customer usage
• Establish the technical direction, culture, and processes for a fast-growing team
• Mentor and develop both engineers and ML engineers/scientists, and influence how the team scales technically and organizationally

Job description

Scale AI is seeking an Engineering Manager for Agent Oversight in a on-site role based in San Francisco, CA, with collaboration across New York. You will lead software and ML engineers, guiding the development of a platform to monitor, evaluate, and improve agentic applications for enterprise and government customers.

You will own the roadmap for deployment, monitoring, evaluation, and ML-driven improvements, work with product and FDE teams, and drive end-to-end delivery while fostering a