Forward Deployed Engineer, Language Models (Onsite) Equity

FDE Times

San Francisco (CA)

On-site

USD 150,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity

Job summary

Artificial Analysis is hiring a Forward Deployed Engineer to own the day-to-day operation of our language model benchmarking stack. You will onboard new models to our evaluation pipeline, run and debug benchmarks, and serve as the primary technical point of contact for AI lab customers, explaining results and addressing methodology questions in real time.

Based in San Francisco, this on-site role requires strong Python skills, API experience, and a proven track record in technical customer

Qualifications

  • 3+ years in a client-facing technical role or equivalent.
  • Strong Python proficiency with large codebases.
  • Hands-on experience with AI/ML model APIs (OpenAI, Anthropic, Google, Meta, etc.).
  • Excellent debugging and issue-resolution across APIs, data pipelines, and code.

Responsibilities

  • Operate and maintain the language model benchmarking pipeline end-to-end.
  • Debug issues across the stack and resolve benchmark anomalies quickly.
  • Serve as the primary technical contact for AI lab customers and explain results clearly.
  • Monitor runs for anomalies and ensure accuracy of published results.
  • Maintain documentation of processes and model configurations.
  • Collaborate with the engineering team on pipeline improvements and best practices.
  • Stay up-to-date with new model releases and API changes.

Skills

Python
Client-facing
API integration
Debugging
English communication

Tools

OpenAI API
Anthropic API

Job description

Artificial Analysis is hiring a Forward Deployed Engineer to own the day-to-day operation of our language model benchmarking stack. You will onboard new models to our evaluation pipeline, run and debug benchmarks, and serve as the primary technical point of contact for AI lab customers, explaining results and addressing methodology questions in real time.

Based in San Francisco, this on-site role requires strong Python skills, API experience, and a proven track record in technical customer

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Frontline Language Model Engineer – AI Benchmarking
Frontline Language Model Engineer – AI Benchmarking

Artificial Analysis • San Francisco (CA)

On-site
USD 140,000 - 190,000
Forward Deployed Engineer - Language Models
Forward Deployed Engineer - Language Models

FDE Times • San Francisco (CA)

On-site
USD 150,000 - 230,000
Equity
Forward Deployed Engineer - Language Models
Forward Deployed Engineer - Language Models

Artificial Analysis • San Francisco (CA)

On-site
USD 140,000 - 190,000
Forward Deployed Engineer
Forward Deployed Engineer

Artificial Analysis • San Francisco (CA)

On-site
USD 120,000 - 170,000
Staff Engineer - Language Model Evaluation
Staff Engineer - Language Model Evaluation

Artificial Analysis • San Francisco (CA)

On-site
USD 180,000 - 240,000
Shape AI direction
World‑expert in AI
Work with leading AI teams
Forward Deployed Engineer | Remote
Forward Deployed Engineer | Remote

Crossing Hurdles • United States

Remote
USD 350,000 - 500,000
Remote Forward Deployed Engineer: Python + AI
Remote Forward Deployed Engineer: Python + AI

FullStack • Jackson (MS)

Remote
USD 140,000 - 210,000
Competitive Salary
Paid Time Off
100% remote work
+4
Applied AI Benchmarking Engineer
Applied AI Benchmarking Engineer

Mercor • San Francisco (CA)

On-site
USD 160,000 - 230,000
Health benefits
Meal stipend
Relocation support
+4
Forward-Deployed AI Engineer & Model Lead
Forward-Deployed AI Engineer & Model Lead

EY • Memphis (TN)

Remote
USD 126,000 - 251,000
Medical and dental coverage
Pension and 401(k)
Paid time off
Senior AI/ML Engineer — On-site SF, Equity & Impact
Senior AI/ML Engineer — On-site SF, Equity & Impact

Artificial Analysis Inc • San Francisco (CA)

On-site
USD 150,000 - 210,000
Equity
Competitive compensation