ML Engineer - AI Coding Expert

Obsidian

Toronto

On-site

CAD 767,000 - 863,000

Part time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments.

You will review model-generated implementations across training, inference systems, MLOps, and LLM applications, applying professional engineering judgment to realistic ML engineering scenarios.

Qualifications

  • 2+ years of professional ML engineering experience.
  • Experience building production ML systems and deployment infrastructure.
  • Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, or Gemini CLI.
  • Ability to evaluate model-generated ML implementations and tradeoffs.
  • Experience deploying ML systems to production is preferred.

Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex ML tasks.
  • Review model-generated implementations involving training, inference, MLOps, or LLM apps.
  • Identify bugs, edge cases, performance issues, and failure modes.
  • Compare outputs from multiple frontier models and assess strengths and weaknesses.
  • Apply professional engineering judgment to realistic ML engineering scenarios.

Skills

ML engineering
Production ML systems
Model deployment
LLM applications
AI-powered products
Evaluation of ML implementations

Tools

Cursor
Claude Code
Codex
Windsurf
Gemini CLI

Job description

About the Role
  • Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project.
  • Contributors help evaluate and improve frontier AI coding models through structured technical assessments.
  • The work focuses on realistic machine learning engineering workflows and model evaluation.
  • Spots are limited and filling quickly on a first come, first serve basis.
What You'll Do
  • Use frontier AI coding agents to complete and evaluate complex machine learning and AI engineering tasks.
  • Review model-generated implementations involving model training, inference systems, MLOps, and LLM applications.
  • Identify bugs, edge cases, performance issues, and failure modes.
  • Compare outputs from multiple frontier models and assess their strengths and weaknesses.
  • Apply professional engineering judgment to realistic ML engineering scenarios.
Time Commitment
  • Sprint based project that runs in 12-24 hour stretches based on client requirement.
Compensation
  • $400 per accepted task.
  • Typical tasks take approximately 2-3 hours after ramp-up.
  • Compensation is tied to accepted work.
Who Should Apply
  • 2+ years of professional machine learning engineering experience.
  • Experience building production ML systems, model deployment infrastructure, LLM applications, or AI-powered products.
  • Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
  • Ability to evaluate model-generated machine learning implementations and technical tradeoffs.
  • Experience deploying ML systems to production is preferred.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - AI Model Evaluator
Data Engineer - AI Model Evaluator

Mercor • Toronto

On-site
CAD 193,000 - 248,000
Data Engineer - AI Model Evaluator
Data Engineer - AI Model Evaluator

Obsidian • Toronto

On-site
CAD 413,000 - 689,000
Data Engineer - AI Model Evaluation
Data Engineer - AI Model Evaluation

Obsidian • Toronto

On-site
CAD 634,000 - 903,000
DevOps Engineer - AI Model Evaluator
DevOps Engineer - AI Model Evaluator

Mercor • Toronto

On-site
CAD 18,000 - 27,000
Forward Deployed Engineer
Forward Deployed Engineer

Robots & Pencils LP • Canada

On-site
CAD 176,612 - 243,680
Forward Deployed AI Engineer
Forward Deployed AI Engineer

EQ Bank • Toronto

On-site
CAD 140,000 - 190,000
Full Stack Engineer
Full Stack Engineer

Compunnel, Inc. • Montreal (administrative region)

On-site
CAD 110,000 - 160,000
ML Engineer – Generative AI & LLMs (Remote)
ML Engineer – Generative AI & LLMs (Remote)

Ample Insight Inc • Toronto

Hybrid
CAD 110,000 - 170,000
Intermediate Software Engineer
Intermediate Software Engineer

AltaML Inc. • Calgary

On-site
CAD 90,000 - 120,000
Frontier AI Data Engineer for Model Evaluation
Frontier AI Data Engineer for Model Evaluation

Obsidian • Toronto

Remote
CAD 227,000 - 324,000