Senior AI Engineering Domain Expert – On-site Bay Area

HumanitApp

California

Hybrid

USD 90,000 - 145,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cincinnatus LLC is hiring a senior engineering and software domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models reason about real engineering and software development work. This is a full-time W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI lab as part of their extended workforce.

Location is hybrid in the Bay Area, California; you must live in the Bay Area and work on-site

Qualifications

  • Bachelor's degree or higher in computer science, software engineering, or a closely related engineering discipline.
  • 4+ years of substantive professional engineering practice, building and shipping production software or engineered systems.
  • Genuine specialization in at least one area (distributed systems, backend infrastructure, security/cryptography, ML systems, developer tooling, or QA/testing).
  • Clear progression to senior level (Senior, Staff, Principal, Architect, or Engineering Lead) with ownership of systems and design decisions.
  • Hands-on work with large language models in professional work and ability to judge plausible answers.

Responsibilities

  • Data QA and reviews: Vet the quality of engineering knowledge work tasks and model outputs.
  • Instruction specs and golden datasets: Write high-quality instruction specs and golden solutions.
  • Benchmarks and domain depth: Design challenging engineering tasks and evaluation sets.
  • Calibration: Align standards with client researchers and translate tacit judgment into explicit criteria.

Skills

Distributed systems
Backend infrastructure
AI fluency
Quality and test engineering
Written communication

Education

Bachelor's degree or higher in CS/Software engineering
MS or PhD preferred

Job description

Future projects, not immediate vacancies. Check each network's country and experience requirements.

Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced AI models.

1. Overview

We are hiring a senior engineering and software domain expert to work directly with a leading AI lab's research and program management teams, improving how frontier AI models reason about real engineering and software development work.

Your engineering expertise is the substance of this role. You will review the quality of engineering knowledge work tasks, write the instruction specs and golden solutions that define what "correct" looks like, and build the benchmarks that show whether the model is genuinely improving. We are looking for a practicing specialist rather than a generalist.

This is a full-time W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI lab as part of their extended workforce. You will be provisioned with client-issued accounts and equipment, and will work inside the client's own tools alongside their research teams.

Location: This is a hybrid role based in the Bay Area, California. You must live in the Bay Area and work on-site with the client's team multiple days each week, when required. This is not a remote role. If you do not currently live in the Bay Area, you must be willing to relocate there at your own cost before the engagement starts. Relocation assistance is not provided.

2. Key Responsibilities • Data QA and reviews: Vet the quality of engineering knowledge work tasks and model outputs, spotting missing behaviors, thin reasoning, code that runs but is subtly wrong, unhandled edge cases, and answers that read well but would not survive a real code review. • Instruction specs and golden datasets: Write high-quality instruction specs, produce golden solutions to engineering problems, and define new engineering tasks that reflect how the work is actually done in practice. • Benchmarks and domain depth: Design challenging engineering tasks and evaluation sets, and help build engineering-specific skills and tools together with the research team. • Calibration: Work with client researchers and specialists in adjacent fields to keep standards consistent, translating tacit engineering judgment into explicit, teachable criteria.

3. Core Qualifications • Education: Bachelor's degree or higher in computer science, software engineering, or a closely related engineering discipline. An MS or PhD is strongly preferred. • Experience: 4+ years of substantive professional engineering practice, building and shipping production software or engineered systems at a reputable organization. Internships and academic coursework alone do not count. • Domain depth: Genuine specialization in at least one area, for example distributed systems and backend infrastructure, security and cryptography, embedded and firmware, machine learning systems, developer tooling and platform engineering, or quality and test engineering. • Seniority: Clear progression to a senior level, for example Senior, Staff, Principal, Architect, or Engineering Lead, with real ownership of systems and design decisions. • Technical evidence: A visible record of engineering output such as shipped systems, granted patents, open source contributions, or published technical work. Preferred. • AI fluency: Hands-on working use of large language models in your professional work, and the judgment to tell a well-reasoned answer from a plausible-sounding wrong one. • Availability: Able to commit reliably to 40 hours per week for an initial engagement of 6 months. • Location: Living in the Bay Area, California, and able to work on-site with the client's team multiple days each week, when required. Candidates not currently based in the Bay Area must be willing to relocate there at their own cost. Relocation assistance is not provided. • Excellent written communication, and the ability to give precise, well-structured written feedback.

About Cincinnatus LLC

Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.

Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve part-time or full-time commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows.

Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus LLC.

Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.

Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.

Mercor eligibility fields: Eligible work locations: United States.

AI evaluation Clinical reasoning Machine learning Research Software engineering

Compensation context

The listing states $65 - $105 / hour. Confirm the final rate, workload, and payment terms during the official application process.

  • You must live in the Bay Area and work on-site with the client's team multiple days each week, when required.
  • If you do not currently live in the Bay Area, you must be willing to relocate there at your own cost before the engagement starts.
  • Candidates not currently based in the Bay Area must be willing to relocate there at their own cost.
Not the right fit?

Use your CV to find relevant roles on HumanitApp. This is separate from a partner application.

Optional role alerts from HumanitApp. Subscribe only if you want weekly emails.

Can I start immediately through an Instant Work Offer?

This listing is not a promise of immediate work. Mercor may send separate offers to prequalified candidates. Read how Instant Work Offers work .

How should I compare the listed pay?

The listing states $65 - $105 / hour. Confirm the final rate, workload, and payment terms during the official application process.

Does Apply use a referral link?

Yes. The button opens the exact verified Mercorlisting using the referral URL published for this role.

Is HumanitApp the employer?

No. HumanitApp independently curates the opportunity. The partner platform manages applications and hiring decisions.

Must I share my details here?

No. Choose the primary Apply action to continue directly without giving HumanitApp your name or email address.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Engineering Domain Expert - GenAI Benchmarks
Senior Engineering Domain Expert - GenAI Benchmarks

Mercor • United States

Hybrid
USD 180,000 - 240,000
GenAI Finance Domain Expert for M&A — Bay Area On-site
GenAI Finance Domain Expert for M&A — Bay Area On-site

Marketframe • California

Hybrid
USD 170,000 - 230,000
Engineering & Software Domain Expert
Engineering & Software Domain Expert

Mercor • United States

Hybrid
USD 180,000 - 240,000
Engineering & Software Domain Expert
Engineering & Software Domain Expert

HumanitApp • California

On-site
USD 90,000 - 145,000
GenAI Sales & Business Ops Lead — On-site Bay Area
GenAI Sales & Business Ops Lead — On-site Bay Area

HumanitApp • Northern (KY)

Hybrid
USD 83,000 - 138,000
Senior Life Sciences AI Domain Expert — Hybrid Bay Area
Senior Life Sciences AI Domain Expert — Hybrid Bay Area

HumanitApp • Northern (KY)

Hybrid
USD 90,000 - 145,000
Senior GenAI Pharma R&D Domain Expert
Senior GenAI Pharma R&D Domain Expert

Mercor • United States

Hybrid
USD 150,000 - 230,000
Senior GenAI Biochem & Life Sciences Domain Expert
Senior GenAI Biochem & Life Sciences Domain Expert

Mercor • United States

Hybrid
USD 120,000 - 180,000
Senior GenAI Accounting & Audit Expert
Senior GenAI Accounting & Audit Expert

HumanitApp • Northern (KY)

Hybrid
USD 90,000 - 130,000
Finance AI Benchmark Architect - Bay Area Hybrid
Finance AI Benchmark Architect - Bay Area Hybrid

Mercor • United States

Hybrid
USD 180,000 - 240,000