Remote Evidence System AI Engineer

SproutsAI, Inc.

San Francisco (CA)

Remote

USD 120,000 - 180,000

Full time

12 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

SproutsAI, Inc. is seeking an ML or software engineer to build an evidence system that determines whether agents are ready for broader responsibility. The role blends evaluation design, experimentation, and production-quality systems to support safer, scalable automation.

You will design offline, shadow, and production evaluations, measure quality, policy, cost, latency, and outcomes, and turn failures into reproducible test cases, collaborating with product and engineering teams.

Qualifications

  • A track record of shipping reliable production software in a relevant domain.
  • Strong systems judgment and comfort reasoning about failure, security, and operability.
  • Ability to explain technical decisions clearly across engineering and product teams.

Responsibilities

  • Create offline, shadow, and production evaluations.
  • Measure quality, policy, cost, latency, and outcomes.
  • Turn failures into reproducible test cases.

Skills

Production software
Evaluation design
Experimentation
Reliability
Security awareness
Clear communication

Tools

Evaluation tooling

Job description

SproutsAI, Inc. is seeking an ML or software engineer to build an evidence system that determines whether agents are ready for broader responsibility. The role blends evaluation design, experimentation, and production-quality systems to support safer, scalable automation.

You will design offline, shadow, and production evaluations, measure quality, policy, cost, latency, and outcomes, and turn failures into reproducible test cases, collaborating with product and engineering teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Applied AI Engineer, Evaluation
Applied AI Engineer, Evaluation

SproutsAI, Inc. • San Francisco (CA)

Remote
USD 120,000 - 180,000
Quality Engineer, AI Systems
Quality Engineer, AI Systems

SproutsAI, Inc. • San Francisco (CA)

Remote
USD 110,000 - 160,000
Remote AI Engineer for Evidence-Based AI Systems
Remote AI Engineer for Evidence-Based AI Systems

Elicit • United States

Remote
USD 120,000 - 170,000
Remote work flexibility
Health, dental, vision benefits
401K matching
+1
Senior AI/ML Engineer - Explainable, Forensics Tech (Remote)
Senior AI/ML Engineer - Explainable, Forensics Tech (Remote)

EvidaraIQ • United States

Remote
USD 140,000 - 200,000
Applied AI Engineer, Agent Reasoning
Applied AI Engineer, Agent Reasoning

SproutsAI, Inc. • San Francisco (CA)

Hybrid
USD 140,000 - 210,000
Remote Enterprise Solutions Engineer (AI & Security)
Remote Enterprise Solutions Engineer (AI & Security)

SproutsAI, Inc. • United States

Remote
USD 110,000 - 160,000
Staff Engineer, AI Proving Grounds (Fully Remote)
Staff Engineer, AI Proving Grounds (Fully Remote)

Simspace • United States

Remote
USD 150,000 - 190,000
AI Engineer — Scalable LLM Systems & Agent Workflows
AI Engineer — Scalable LLM Systems & Agent Workflows

Introspection • San Francisco (CA)

On-site
USD 140,000 - 210,000
Enterprise Sales Engineer
Enterprise Sales Engineer

SproutsAI, Inc. • United States

Remote
USD 110,000 - 160,000
Staff Software Engineer, Agent Runtime
Staff Software Engineer, Agent Runtime

SproutsAI, Inc. • San Francisco (CA)

Remote
USD 140,000 - 210,000