AI Proving Grounds Lead - Evaluation & Automation

Simspace

United States

Remote

USD 150,000 - 190,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Simspace in the United States is seeking a leading figure to drive the evaluation and scoring work for AI Proving Grounds, guiding a team of software engineers and data scientists and implementing and debugging software and automation.

You will define assessment questions, reference cases, and acceptance criteria, then deliver results from execution through evidence capture and scoring, review architecture, build tests for missing evidence and incompatible versions, and maintain a ranked plan

Qualifications

  • Experience leading cross-functional engineering teams.
  • Strong background in software development and data science testing.

Responsibilities

  • Lead the evaluation and scoring work for AI Proving Grounds, managing a team of software engineers and data scientists while implementing and debugging software and automation.
  • Define assessment questions, reference cases, and acceptance criteria, then deliver results from execution through evidence capture and scoring.
  • Review architecture and code, build tests for missing evidence and incompatible versions, and maintain a ranked plan accounting for support and maintenance.

Job description

Simspace in the United States is seeking a leading figure to drive the evaluation and scoring work for AI Proving Grounds, guiding a team of software engineers and data scientists and implementing and debugging software and automation.

You will define assessment questions, reference cases, and acceptance criteria, then deliver results from execution through evidence capture and scoring, review architecture, build tests for missing evidence and incompatible versions, and maintain a ranked plan

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Engineer, AI Proving Grounds (Fully Remote)
Staff Engineer, AI Proving Grounds (Fully Remote)

Simspace • United States

Remote
USD 150,000 - 190,000
Staff Engineer, AI Evaluation & Software Platforms
Staff Engineer, AI Evaluation & Software Platforms

SimSpace Corporation • United States

Remote
USD 160,000 - 220,000
Equity stock options
Annual bonuses
Unlimited vacation
+1
Director of Fullstack Engineering - AI Proving Grounds
Director of Fullstack Engineering - AI Proving Grounds

Simspace • United States

Hybrid
USD 150,000 - 210,000
Director of Fullstack Engineering - AI Proving Grounds
Director of Fullstack Engineering - AI Proving Grounds

SimSpace Corporation • United States

Hybrid
USD 160,000 - 220,000
Health benefits
401(k) with match
Equity stock options
+3
Senior AI Eval Engineer — LLM Judge & Data Pipelines
Senior AI Eval Engineer — LLM Judge & Data Pipelines

DroneDeploy, Inc. • Austin (TX)

Hybrid
USD 141,000 - 194,000
Equity compensation
Bonus incentive
AI Evaluation & Measurement Engineer
AI Evaluation & Measurement Engineer

DEFCON AI, Inc. • United States

Remote
USD 120,000 - 170,000
Senior AI Evaluation Platform Lead
Senior AI Evaluation Platform Lead

EPAM Systems Inc • United States

Remote
USD 140,000 - 190,000
Senior AI Quality & Evaluation Engineer for RAG & Security
Senior AI Quality & Evaluation Engineer for RAG & Security

Solvd • United States

On-site
USD 120,000 - 180,000
Enterprise AI Evaluation Lead & Methodology Scientist
Enterprise AI Evaluation Lead & Methodology Scientist

Jobgether • United States

Remote
USD 150,000 - 180,000
Senior AI Quality & Evaluation Engineer – RAG & Gatekeeper
Senior AI Quality & Evaluation Engineer – RAG & Gatekeeper

Solvd, Inc. • United States

On-site
USD 110,000 - 190,000