CAD Design Engineer - AI Evaluation

Mercor

San Francisco (CA)

On-site

USD 40,000 - 70,000

Part time

12 days ago

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is partnering with a leading AI lab to craft realistic design tasks for frontier models. We hire engineers across Mechanical CAD, Electronics/PCB, and 3D/Spatial-Temporal tracks to design prompts, inputs, and graders.

You will run tasks against frontier models, iterate with an AI coding agent, version work in Git, and document the rationale behind synthetic data. Role starts immediately; 20+ hours weekly in San Francisco.

Qualifications

  • 3+ years of hands-on design experience in CAD, PCB, or 3D design.
  • Portfolio of your own design work required.
  • Ability to write Python as part of engineering work and use Git.
  • Experience with AI-assisted design tasks is a plus.

Responsibilities

  • Turn real design work into self-contained tasks with prompts, inputs, and graders.
  • Iterate tasks with an AI coding agent and version in Git.
  • Run tasks against frontier models and close leaks to increase task hardness.
  • Pass automated QA and peer review and document rationale behind synthetic data.
  • Attend onboarding and calibration sessions.

Skills

Python scripting
Git
Portfolio

Tools

SolidWorks
AutoCAD
FreeCAD
Siemens NX
CATIA
CadQuery
build123d
KiCad
Blender Python API

Job description

About the Role

Mercor is partnering with a leading AI lab to measure how well frontier AI models perform real engineering design work. We're hiring experienced CAD, PCB, and 3D design engineers to build realistic, difficult design tasks that expose where AI still falls short.

You'll design a realistic engineering problem (a prompt, input files, and a grader that checks the result), run it against frontier models, and refine it until it is fair, realistic, and hard. Realism always comes before difficulty.

We're Hiring Across Three Tracks
  • Mechanical CAD: parts, assemblies, mechanisms, and tolerancing. Professional experience with SolidWorks, AutoCAD, FreeCAD, or a comparable CAD tool is the baseline; Siemens NX and/or CATIA experience is highly valued. Tasks are built with code-based CAD (build123d, CadQuery, OpenCASCADE) and mesh tools (trimesh, manifold3d, Open3D)

  • Electronics / PCB: schematic capture, layout, DRC/ERC, footprints, and enclosure fit using KiCad (kicad-cli, pcbnew Python API); openEMS or RF/EM simulation is a plus

  • 3D / Spatial-Temporal: scene construction, animation, rigging, physics, and camera work in headless Blender driven by Python, plus rendering with PyVista/VTK

What You'll Do
  • Turn real design work from your field into self-contained tasks: a prompt, input files (STEP, KiCad projects, .blend files, meshes), and an automated grader

  • Build and iterate on tasks with an AI coding agent (Claude Code) and version them in Git

  • Run each task against frontier models, read the model transcripts, and close leaks and shortcuts until the task is hard for the right reasons

  • Pass automated QA and peer review, and document the rationale behind any synthetic data you create

  • Attend onboarding and calibration sessions

You're a Good Fit If You
  • Have 3+ years of hands-on design experience in at least one track (industry, research lab, or serious freelance work)

  • For the Mechanical CAD track: have hands-on professional experience with SolidWorks, AutoCAD, FreeCAD, or a comparable CAD tool

  • Have shipped real deliverables: fabricated boards, manufactured parts, production 3D assets, or published research

  • Can share a portfolio of your own design work (a portfolio link is required to apply)

  • Write Python as part of your engineering work and are comfortable with the command line and Git

  • Can judge whether a design is actually correct, not just whether it looks right

Bonus Qualifications
  • Siemens NX and/or CATIA experience (parts, assemblies, surfacing, drawings, or PLM such as Teamcenter/ENOVIA)

  • Experience scripting design tools: build123d/CadQuery, FreeCAD Python, NX Open, KiCad scripting, or Blender's Python API (bpy)

  • FEA, CFD, circuit, or EM simulation experience

  • Degree (BS/MS/PhD) in Mechanical, Electrical, Aerospace, Robotics, Computer Graphics, or a related field

  • Prior AI training, benchmark, or evaluation work, or heavy daily use of AI coding agents

Role Highlights
  • Minimum 20 hours per week, active at least 5 days per week

  • Role starts immediately, and applications are reviewed on a rolling basis

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

CAD Design Engineer - AI Evaluation - AI Trainer
CAD Design Engineer - AI Evaluation - AI Trainer

Mercor • Detroit (MI)

On-site
USD 41,000 - 83,000
PCB Design Specialist - Fully Remote
PCB Design Specialist - Fully Remote

Mercor • San Francisco (CA)

Remote
USD 120,000 - 180,000
PCB Design Specialist - Fully Remote | Up to $100/hr
PCB Design Specialist - Fully Remote | Up to $100/hr

Mercor • San Francisco (CA)

Remote
USD 40,000 - 60,000
AI-Driven CAD & PCB Design Engineer (20+ hrs/wk)
AI-Driven CAD & PCB Design Engineer (20+ hrs/wk)

Mercor • San Francisco (CA)

On-site
USD 40,000 - 70,000
AI Trainer – Mechanical Engineering
AI Trainer – Mechanical Engineering

Planet Pharma • San Francisco (CA)

On-site
USD 90,000 - 150,000
Remote PCB Design Engineer for AI Evaluation Tasks
Remote PCB Design Engineer for AI Evaluation Tasks

Mercor • San Francisco (CA)

Remote
USD 120,000 - 180,000
Senior PCB Design Engineer for AI Benchmarking Tasks
Senior PCB Design Engineer for AI Benchmarking Tasks

Mercor • San Francisco (CA)

Remote
USD 40,000 - 60,000
Engineering Design and Simulation (CAD & Simulation Consultant) - Aerospace / Mechanical / Electrical Engineering
Engineering Design and Simulation (CAD & Simulation Consultant) - Aerospace / Mechanical / Electrical Engineering

Prolific • United States

On-site
USD 83,000 - 165,000
Frontier CAD Design Engineer for AI Benchmarking
Frontier CAD Design Engineer for AI Benchmarking

Mercor • Detroit (MI)

On-site
USD 41,000 - 83,000
CAD Engineer - AI Trainer
CAD Engineer - AI Trainer

Mindrift • Pennsylvania

Remote
USD 56,000 - 95,000
Fully remote
Performance-based bonuses