Staff Software Engineer, Agent Quality & AI Infrastructure

Menlo Ventures; New York (NY); On-site; USD 190,000 - 270,000; Full time

Job summary

Databricks is seeking a Staff Software Engineer - Agent Quality in New York to lead efforts in evaluating AI Agents. You will create infrastructure for benchmarking and quality measurement in a collaborative environment.

Ideal candidates have 6+ years of experience and strong Python skills. The role offers a significant influence on technical direction and aims to establish a rigorous improvement feedback loop.

Local pay range is $190,000 to $270,000 USD.

Qualifications

• 6+ years of industry experience in software systems.
• Strong Python programming skills with a focus on production infrastructure.
• Experience building reliable distributed systems or data pipelines.

Responsibilities

• Develop a foundational evaluation infrastructure for Genie Agents.
• Build a feedback loop for agent improvement based on evaluation results.
• Shape the technical direction for agent quality infrastructure.

Skills

Python programming

Distributed systems

Data pipelines

Technical quality ownership

Tools

Devtools

CI/CD platforms

Observability tooling

Job description

Databricks is seeking a Staff Software Engineer - Agent Quality in New York to lead efforts in evaluating AI Agents. You will create infrastructure for benchmarking and quality measurement in a collaborative environment.

Ideal candidates have 6+ years of experience and strong Python skills. The role offers a significant influence on technical direction and aims to establish a rigorous improvement feedback loop.

Local pay range is $190,000 to $270,000 USD.