Senior Staff Frontier Agents Engineer

Scale AI, Inc.; San Francisco (CA); On-site; USD 288,000 - 360,000; Full time

Benefits offered by this job

Equity

Health benefits

Retirement plan

Learning stipend

Commuter stipend

Job summary

Scale AI, Inc. is looking for a Senior Staff Frontier Agents Engineer to be the technical bridge between its AI capabilities and strategic customers. This role demands deep engineering expertise and direct involvement with customer teams to integrate AI into their workflows, ensuring seamless deployment and adaptation.

The ideal candidate will have strong Python skills, experience with enterprise cloud platforms, and over 12 years of software engineering experience. The role is pivotal in developing customized AI solutions that meet unique customer challenges.

Benefits include a competitive salary between $288,000 and $360,000, equity options, and comprehensive health coverage.

Qualifications

• Proven ability to work with customers in a technical consulting or product engineering role.
• Deep understanding of LLMs including prompting techniques.
• Experience with containerization and CI/CD pipelines.

Responsibilities

• Partner directly with customers to understand their technical needs.
• Design and implement integrations between Scale AI's platform and customer data environments.
• Develop production-grade AI agents tailored to customer use cases.

Skills

Production Python expertise

Strong problem-solving skills

Excellent communication skills

Education

12+ years of software engineering experience

Tools

Docker

Kubernetes

AWS

GCP

Azure

Job description

Role Overview

As a Senior Staff Frontier Agents Engineer on our Enterprise team, you'll be the technical bridge between Scale AI's cutting‑edge AI capabilities and our most strategic customers. You'll work with enterprise clients to understand their unique challenges, architect custom AI solutions, and ensure successful deployment and adoption of AI systems in production environments.

This is a hands‑on technical role that combines deep engineering expertise with customer‑facing problem solving. You'll work directly with customer engineering teams to integrate AI into their critical workflows.

Key Responsibilities

Customer Integration & Deployment

• Partner directly with enterprise customers to understand their technical infrastructure, data pipelines, and business requirements
• Design and implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
• Build robust data connectors and ETL pipelines to ingest, process, and prepare customer data for AI workflows
• Deploy and configure AI models and agents within customer security and compliance boundaries

AI Agent Development

• Develop production‑grade AI agents tailored to customer use cases across domains such as customer support, data analysis, content generation, and workflow automation
• Architect multi‑agent systems that orchestrate between different models, tools, and data sources
• Implement evaluation frameworks to measure agent performance and iterate toward business objectives
• Design human‑in‑the‑loop workflows and feedback mechanisms for continuous agent improvement

Prompt Engineering & Optimization

• Create sophisticated prompt engineering strategies optimized for customer‑specific domains and data
• Build and maintain prompt libraries, templates, and best practices for customer use cases
• Conduct systematic prompt experimentation and A/B testing to improve model outputs
• Implement RAG (Retrieval Augmented Generation) systems and fine‑tuning pipelines where appropriate

Technical Leadership & Collaboration

• Serve as the primary technical point of contact for strategic enterprise accounts
• Collaborate with customer data scientists, ML engineers, and software developers to ensure smooth integration
• Provide technical training and knowledge transfer to customer teams
• Work closely with Scale's product and engineering teams to translate customer needs into product improvements
• Document technical architectures, integration patterns, and best practices

Problem Solving & Innovation

• Debug complex technical issues across the entire stack, from data pipelines to model outputs
• Rapidly prototype solutions to unblock customers and prove out new use cases
• Stay current on the latest AI/ML research and tools, bringing innovative approaches to customer problems
• Identify opportunities for productization based on common customer patterns

Required Qualifications

• 12+ years of software engineering experience with strong fundamentals in data structures, algorithms, and system design
• Production Python expertise with experience in modern ML/AI frameworks (e.g., LangChain, LlamaIndex, HuggingFace, OpenAI API)
• Experience with cloud platforms (AWS, GCP, or Azure) and modern data infrastructure
• Strong problem‑solving skills with the ability to navigate ambiguous requirements and rapidly iterate toward solutions
• Excellent communication skills with the ability to explain complex technical concepts to both technical and non‑technical audiences

Preferred Qualifications

Agent Development

• Deep understanding of LLMs including prompting techniques, embeddings, and RAG architectures
• Experience building and deploying AI agents or autonomous systems in production
• Knowledge of vector databases and semantic search systems
• Contributions to open‑source AI/ML projects

Infrastructure Guru

• Experience with containerization (Docker, Kubernetes) and CI/CD pipelines
• Experience using Terraform, Bicep, or other Infrastructure as Code (IaC) tools
• Previous work in a devops, platform, or infra role
• Familiarity with enterprise security, compliance, and governance requirements (SOC 2, GDPR, HIPAA)

Customer Product Whisperer

• Proven ability to work with customers in a technical consulting, solutions engineering, or product engineering role
• Domain expertise in verticals such as finance, healthcare, government, or manufacturing
• Experience with technical enablement or teaching programs

Sample Projects

• Deep Research for Due Diligence: For a global professional services firm, developed a sophisticated deep research agent to assist in due diligence, employing a multi‑agent architecture for robust fact‑checking and integrating several internal tools. The solution reliably saves employees hundreds of hours weekly.
• Churn Prediction: Built a model utilizing customer data to predict churn likelihood for a telco organization; the system curates personalized offers and integrates into a next‑best‑action copilot, reducing churn.
• Data Extraction Voice Agent: Partnered with a healthcare organization to create a lifelike voice agent and avatar for gathering unstructured health information from patients, with low‑latency conversational flow and safety guardrails, saving nursing staff hundreds of hours each week.

Benefits

• Base salary range $288,000–$360,000 USD (USD)
• Equity and comprehensive benefits, including health, dental, vision, retirement, learning stipend, PTO, and commuter stipend

EEO Statement

We are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity, or veteran status. We provide reasonable accommodations to applicants with physical or mental disabilities and comply with U.S. Department of Labor pay transparency provisions. A privacy policy governs the collection and use of applicant data.