Staff AI Quality Engineer

Idme; Mountain View (CA); On-site; USD 217,565 - 271,000; Full time

Benefits offered by this job

Comprehensive medical, dental, vision insurance

401(k) with company match

Unlimited paid time off

Job summary

Idme in Mountain View is seeking a Staff Engineer to manage AI agent evaluations and ensure quality standards. You will establish testing frameworks and collaborate with product and platform teams.

The ideal candidate should have at least 8 years in software systems, experience with AI tools, and strong communication skills. Comprehensive benefits include medical, dental, vision, and a 401(k) with company match.

Qualifications

• 8+ years building and operating production software systems.
• Strong communication skills across engineering, product, and leadership.
• Experience with AI-assisted development tools.

Responsibilities

• Define AI Quality Standards and framework for evaluating AI agents.
• Build Eval Infrastructure for agent behavior and output.
• Collaborate with cross-functional teams to embed quality.

Skills

Building and operating production software systems

Evaluating or testing LLM-powered features

Backend engineering fundamentals in Python, Java, Go

Designing test infrastructure

Improving developer experience

Education

Bachelor's degree in Computer Science or Engineering

Job description

Idme in Mountain View is seeking a Staff Engineer to manage AI agent evaluations and ensure quality standards. You will establish testing frameworks and collaborate with product and platform teams.

The ideal candidate should have at least 8 years in software systems, experience with AI tools, and strong communication skills. Comprehensive benefits include medical, dental, vision, and a 401(k) with company match.