Staff Software Engineer, Agent Quality & Evaluation

Databricks Inc.; New York (NY); On-site; USD 190,000 - 270,000; Full time

Job summary

Databricks Inc. is seeking a Staff Software Engineer - Agent Quality in New York, NY. This role focuses on building evaluation infrastructure for AI Agents, ensuring quality and continuous improvement.

The ideal candidate will have over 6 years of experience, strong Python skills, and the ability to handle complex infrastructure challenges. The role includes designing systems and collaborating across teams to drive data-driven improvements.

Compensation ranges from $190,000 to $270,000, reflecting our commitment to fair pay.

Qualifications

• 6+ years of industry experience building software systems.
• Strong Python programming skills.
• Experience with distributed systems and data pipelines.
• Ability to design rigorous systems.
• Comfort working across ambiguous research and product boundaries.

Responsibilities

• Stand up foundational evaluation infrastructure for Genie Agents.
• Build the flywheel connecting evaluation results to agent improvement.
• Shape technical direction for agent quality infrastructure.

Skills

Python programming

Building production infrastructure

Distributed systems

Data pipelines

Reliability and correctness

Operational maturity

Tools

CI/CD platforms

Observability tooling

Testing frameworks

Job description

Databricks Inc. is seeking a Staff Software Engineer - Agent Quality in New York, NY. This role focuses on building evaluation infrastructure for AI Agents, ensuring quality and continuous improvement.

The ideal candidate will have over 6 years of experience, strong Python skills, and the ability to handle complex infrastructure challenges. The role includes designing systems and collaborating across teams to drive data-driven improvements.

Compensation ranges from $190,000 to $270,000, reflecting our commitment to fair pay.