Engineering Manager - Agent Oversight & AI Platform

Visa Hunt; New York, San Francisco (NY, CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Equity

Health, dental & vision

Retirement benefits

Learning stipend

Paid time off

Commuter stipend

Job summary

Scale is seeking an Engineering Manager for Agent Oversight in New York, leading a team that builds a platform for monitoring, evaluating, and improving agentic applications across enterprises and government customers. You will manage the engineering team, drive delivery, and collaborate with customers and internal partners to productionize capabilities.

You will oversee deployment, monitoring, evaluation, and ML-driven improvement, while shaping technical direction and processes for a

Qualifications

• 7+ years of engineering experience with production ML/LLM systems.
• 2+ years directly managing engineers or ML engineers.
• Experience with agent architectures and multi-agent systems.
• Experience owning the lifecycle of platform-level infrastructure.
• Ability to translate enterprise requirements into platform capabilities.
• Proven track record of growing high-performing teams.

Responsibilities

• Lead multi-disciplinary team of software and ML engineers to deliver Scale Generative AI Platform.
• Own roadmap for deployment, monitoring, evaluation, and ML-driven improvements.
• Collaborate with customers, forward-deployed teams, product, and internal engineering teams to translate requirements.
• Build and ship features end-to-end from design to testing.
• Drive high-velocity experimentation based on real customer usage.
• Set technical direction, culture, and processes for fast-growing team.
• Mentor engineers and ML engineers/scientists and scale team.

Skills

ML/LLM systems

Engineering leadership

Platform infrastructure

System design

Cross-functional collaboration

Mentoring engineers

Tools

Observability tools

Job description

Scale is seeking an Engineering Manager for Agent Oversight in New York, leading a team that builds a platform for monitoring, evaluating, and improving agentic applications across enterprises and government customers. You will manage the engineering team, drive delivery, and collaborate with customers and internal partners to productionize capabilities.

You will oversee deployment, monitoring, evaluation, and ML-driven improvement, while shaping technical direction and processes for a