Enterprise AI Evaluation Lead & Methodology Scientist

Jobgether

United States

Remote

USD 150,000 - 180,000

Full time

40 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Jobgether in the United States is seeking a lead engineer to develop a rigorous evaluation framework for enterprise AI agents, building experimental methodologies and production-ready tooling.

You will design and execute statistically sound experiments to assess planner models, execution models, and inference optimization strategies, and provide technical leadership with standards and actionable deployment recommendations.

Responsibilities

  • Lead the development of a rigorous evaluation framework for enterprise AI agents, including experimental methodology and production-quality tools.
  • Design and execute statistically sound experiments to assess planner models, execution models, and inference optimization strategies.
  • Provide technical leadership, establish evaluation standards, and deliver actionable recommendations supporting enterprise deployment decisions.

Job description

Jobgether in the United States is seeking a lead engineer to develop a rigorous evaluation framework for enterprise AI agents, building experimental methodologies and production-ready tooling.

You will design and execute statistically sound experiments to assess planner models, execution models, and inference optimization strategies, and provide technical leadership with standards and actionable deployment recommendations.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Enterprise AI Evaluation Scientist (Remote)
Principal Enterprise AI Evaluation Scientist (Remote)

Jobgether • United States

Remote
USD 200,000 - 300,000
Remote work within the United States
Hands-on leadership in AI evaluation
Client-facing, enterprise-focused role
Principal Applied Scientist (Fully Remote)
Principal Applied Scientist (Fully Remote)

Jobgether • United States

Remote
USD 150,000 - 180,000
Senior AI Evaluation Scientist (Planner-Executor)
Senior AI Evaluation Scientist (Planner-Executor)

Robots & Pencils • United States

Remote
USD 200,000 - 300,000
AI Engineering Lead: Evaluations & System Integration
AI Engineering Lead: Evaluations & System Integration

Bain & Company, Inc. • Boston (MA)

On-site
USD 198,000 - 238,000
Medical coverage
Dental coverage
Vision coverage
+4
Staff Engineer – Enterprise AI Evaluation & Automation
Staff Engineer – Enterprise AI Evaluation & Automation

Perplexity AI • New York (NY)

On-site
USD 150,000 - 230,000
AI Engineer - Agentic Systems & Evaluation
AI Engineer - Agentic Systems & Evaluation

Glean • San Francisco (CA)

Hybrid
USD 200,000 - 280,000
Home office stipend
Education & wellness stipends
Daily healthy lunches
Lead AI Evaluation Engineer — Agent Quality
Lead AI Evaluation Engineer — Agent Quality

FurtherAI • San Francisco (CA)

On-site
USD 140,000 - 210,000
Fully covered health, dental, and visa
Competitive compensation, stock + 401k
Unlimited PTO
+4
AI Evaluation Engineer: RL Environments & Agents
AI Evaluation Engineer: RL Environments & Agents

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 210,000
Staff Software Engineer, Enterprise AI Evaluation
Staff Software Engineer, Enterprise AI Evaluation

Perplexity • San Francisco (CA)

On-site
USD 180,000 - 240,000
Remote AI QA Architect & Evaluation Lead
Remote AI QA Architect & Evaluation Lead

Meridial • United States

Remote
USD 8,300 - 90,000