Staff Software Engineer – AI Agent Quality & Evaluation

Databricks; New York (NY); In loco; USD 200.000 - 265.000; Tempo pieno

Descrizione del lavoro

Databricks is seeking a Staff Software Engineer - Agent Quality to join our New York team as a founding member of a new group focused on evaluating and improving Databricks' AI Agents.

You will design and scale the infrastructure, tooling, and workflows that let researchers and engineers rigorously evaluate agents, feeding results back into improvements across development, training, and production cycles.

Competenze

• 6+ years of industry experience building software systems.
• Strong Python programming skills, with production or research infra experience.
• Experience with distributed systems, data pipelines, or large-scale infra focusing on reliability.
• Ability to design rigorous systems producing trustworthy signals for complex apps.
• Comfort across research and product boundaries and collaboration with researchers and engineers.
• High bar for technical quality with ownership and roadmap influence.

Mansioni

• Stand up foundational evaluation infrastructure for Genie Agents.
• Build a flywheel connecting evaluation results to agent improvements.
• Shape long-term technical direction for agent quality infrastructure.
• Collaborate with researchers and engineers to scale evaluation across teams.

Conoscenze

Python

Distributed systems

Production infra

Reliability

Cross-functional

Technical leadership

Strumenti

CI/CD platforms

Observability tooling

Benchmarking infra

Descrizione del lavoro

Databricks is seeking a Staff Software Engineer - Agent Quality to join our New York team as a founding member of a new group focused on evaluating and improving Databricks' AI Agents.

You will design and scale the infrastructure, tooling, and workflows that let researchers and engineers rigorously evaluate agents, feeding results back into improvements across development, training, and production cycles.