Senior AI Infra Engineer & Evaluation Systems Lead

Vanta

United States

Remote

USD 180,000 - 260,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary
Equity
Health benefits
Parental leave
Flexible PTO
401(k) matching

Job summary

Vanta is building background-agent infrastructure to enable reliable automated engineering work. You will help develop evaluation systems for agent performance using outcomes and cost, ensuring measurable quality and scalable experiments. We value leadership and a track record of delivering robust software in distributed systems.

We offer a competitive salary, equity, and comprehensive medical, dental, and vision coverage. 16 weeks parental leave, flexible PTO, and matching 401(k) are available.

Qualifications

  • Substantial software engineering experience with technical leadership.
  • Experience improving AI systems and driving quality through measurement.

Responsibilities

  • Build background-agent infrastructure for reliable automated engineering work.
  • Develop evaluation systems for agent performance using outcomes and cost.

Skills

Substantial software engineering
AI systems improvement

Job description

Vanta is building background-agent infrastructure to enable reliable automated engineering work. You will help develop evaluation systems for agent performance using outcomes and cost, ensuring measurable quality and scalable experiments. We value leadership and a track record of delivering robust software in distributed systems.

We offer a competitive salary, equity, and comprehensive medical, dental, and vision coverage. 16 weeks parental leave, flexible PTO, and matching 401(k) are available.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior AI Developer Experience Engineer
Remote Senior AI Developer Experience Engineer

Bazeta • United States

Remote
USD 140,000 - 230,000
Industry-competitive salary and equity
Comprehensive medical, dental, and vis
16 weeks paid Parental Leave
+5
Senior Software Engineer- AI/Automation & Reliability Remote
Senior Software Engineer- AI/Automation & Reliability Remote

Vanta • United States

Hybrid
USD 140,000 - 200,000
Equity
Remote work
Parental leave
+2
Senior Software Engineer, AI DX (Fully Remote)
Senior Software Engineer, AI DX (Fully Remote)

Vanta • United States

Remote
USD 180,000 - 260,000
Competitive salary
Equity
Health benefits
+3
Senior Software Engineer (Fully Remote)
Senior Software Engineer (Fully Remote)

Vanta • United States

Hybrid
USD 140,000 - 200,000
Equity
Remote work
Parental leave
+2
Senior AI Engineer: Evaluation & Optimization (Remote)
Senior AI Engineer: Evaluation & Optimization (Remote)

Vantaca • Palo Alto (CA)

Hybrid
USD 200,000 - 260,000
Medical, Dental, Vision
401K with company match
Remote Flexible
+1
Senior AI DX Engineer - Build Autonomous Dev Tools (Remote)
Senior AI DX Engineer - Build Autonomous Dev Tools (Remote)

Vanta • United States

Remote
USD 150,000 - 210,000
Salary & equity
Medical, dental, vision coverage
Parental leave (16 weeks)
+11
Senior Software Engineer, AI Developer Experience
Senior Software Engineer, AI Developer Experience

Vanta • United States

Remote
USD 150,000 - 210,000
Salary & equity
Medical, dental, vision coverage
Parental leave (16 weeks)
+11
Senior Software Engineer, AI Developer Experience
Senior Software Engineer, AI Developer Experience

Bazeta • United States

Remote
USD 140,000 - 230,000
Industry-competitive salary and equity
Comprehensive medical, dental, and vis
16 weeks paid Parental Leave
+5
Senior AI Infra & Optimization Architect
Senior AI Infra & Optimization Architect

Vantaca • Palo Alto (CA)

On-site
USD 200,000 - 260,000
NY, SF New York, San Francisco Member of Technical Staff - AI
NY, SF New York, San Francisco Member of Technical Staff - AI

Valkai, Inc. • New York (NY)

On-site
USD 140,000 - 210,000
Equity
Health insurance
Paid time off
+1