Engineering Manager: Agent Oversight & Production AI

United States Digital Space LLC; New York, San Francisco (NY, CA); Hybrid; USD 248,000 - 311,000; Full time

Benefits offered by this job

Health, dental, vision coverage

Equity-based compensation

Learning and development stipend

Generous PTO

Job summary

Scale is seeking an Engineering Manager for Agent Oversight to lead the team building our platform for monitoring, evaluating, and improving agentic applications across enterprise and government customers.

You will manage the engineering team, drive technical delivery, and work cross-functionally with customers and internal partners to production, with the ambition of setting the industry standard for how agentic applications are monitored and improved.

Qualifications

• 7+ years of engineering experience with 2+ years in people management of engineers or ML engineers.
• Hands-on familiarity with agent architectures and multi-agent orchestration.
• Ability to review ML experiment design and evaluation methods.
• Experience owning lifecycle of platform-level infrastructure at scale.
• Experience collaborating with product managers and customers to translate requirements into capabilities.
• Proven track record of building and growing high-performing teams.

Responsibilities

• Lead a cross-functional team to deliver the Scale Generative AI Platform.
• Own the platform roadmap for deployment, monitoring, evaluation, and ML-driven improvement.
• Translate enterprise and government requirements into platform capabilities.
• Build and ship features end-to-end from design to testing.
• Drive high-velocity experimentation based on customer usage.
• Set technical direction, culture, and processes for a fast-growing team.
• Mentor engineers and ML engineers/scientists and scale the team.

Skills

Engineering management

Agent architectures

ML/LLM systems

Experiment design review

Platform infrastructure

Cross-functional collaboration

Hiring and coaching

Tools

Monitoring platforms

ML tooling

Job description

Scale is seeking an Engineering Manager for Agent Oversight to lead the team building our platform for monitoring, evaluating, and improving agentic applications across enterprise and government customers.

You will manage the engineering team, drive technical delivery, and work cross-functionally with customers and internal partners to production, with the ambition of setting the industry standard for how agentic applications are monitored and improved.