Senior AI Systems Engineer & Domain Expert - Bay Area

Mercor

San Francisco (CA)

On-site

USD 90,000 - 145,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is hiring a senior Engineering & Software Domain Expert to collaborate with a leading AI lab, refining how models reason about engineering work. You will define correct outputs, craft benchmarks, and maintain high standards across tasks and datasets.

The role requires 4+ years of practice, a strong technical background, and on-site Bay Area presence. This full-time W-2 position with Cincinnatus LLC places you close to client teams with relocation at your cost.

Qualifications

  • Bachelor's degree or higher in computer science, software engineering, or a closely related discipline.
  • 4+ years of substantive professional engineering practice shipping production software or engineered systems.
  • Genuine specialization in at least one domain area (distributed systems, security/cryptography, embedded/firmware, ML systems, developer tooling, or quality/testing).
  • Clear progression to a senior level (Senior/Staff/Principal/Architect/Engineering Lead) with ownership of systems and design decisions.
  • A demonstrable engineering output (shipped systems, patents, open source, or published work) preferred.
  • Hands-on AI fluency with large language models in professional work and sound judgment.

Responsibilities

  • Data QA and reviews: Vet quality of engineering knowledge tasks and model outputs, spot issues, and ensure robust reviews.
  • Instruction specs and golden datasets: Write instruction specs, produce golden solutions, and define new engineering tasks reflecting real-world practice.
  • Benchmarks and domain depth: Design challenging engineering tasks and evaluation sets, and build engineering skills with the research team.
  • Calibration: Align standards with client researchers, translating tacit judgments into explicit criteria.

Skills

Data QA reviews
Instruction specs
Golden datasets
Calibration
AI fluency
Written communication

Education

Bachelor's degree or higher in computer science or related engineering
MS or PhD strongly preferred

Job description

Mercor is hiring a senior Engineering & Software Domain Expert to collaborate with a leading AI lab, refining how models reason about engineering work. You will define correct outputs, craft benchmarks, and maintain high standards across tasks and datasets.

The role requires 4+ years of practice, a strong technical background, and on-site Bay Area presence. This full-time W-2 position with Cincinnatus LLC places you close to client teams with relocation at your cost.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Engineering & Software Domain Expert
Senior Engineering & Software Domain Expert

Mercor • San Francisco (CA)

Hybrid
USD 180,000 - 260,000
Engineering & Software Domain Expert
Engineering & Software Domain Expert

Mercor • San Francisco (CA)

On-site
USD 90,000 - 145,000
Engineering & Software Domain Expert
Engineering & Software Domain Expert

Marketframe • California

On-site
USD 180,000 - 240,000
Engineering & Software Domain Expert
Engineering & Software Domain Expert

HumanitApp • California

On-site
USD 90,000 - 145,000
Senior GenAI Systems Engineer (Engineering Domain Expert)
Senior GenAI Systems Engineer (Engineering Domain Expert)

Marketframe • California

On-site
USD 180,000 - 240,000
Engineering & Software Domain Expert
Engineering & Software Domain Expert

Mercor • United States

Hybrid
USD 180,000 - 240,000
Engineering & Software Domain Expert
Engineering & Software Domain Expert

Mercor • San Francisco (CA)

Hybrid
USD 180,000 - 260,000
Senior Legal AI Trainer & Evaluation Expert (Bay Area)
Senior Legal AI Trainer & Evaluation Expert (Bay Area)

Mercor • San Francisco (CA)

Hybrid
USD 83,000 - 138,000
Referral reward up to $1,600
On-site work in Bay Area
Senior Accounting & Audit Domain Expert for GenAI
Senior Accounting & Audit Domain Expert for GenAI

Mercor • United States

Hybrid
USD 140,000 - 210,000
Senior Legal AI Trainer & Evaluator (Bay Area)
Senior Legal AI Trainer & Evaluator (Bay Area)

Mercor • United States

Hybrid
USD 180,000 - 230,000