Frontier ML Engineer: Benchmark AI Coding Models

Obsidian

New York (NY)

On-site

USD 207,000 - 303,000

Part time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Obsidian is seeking contributors to support a Frontier Code Agents project with focus on realistic ML engineering workflows and model evaluation. You will analyze model-generated code, assess training and deployment considerations, and identify issues across multiple frontier models.

Applicants should have 2+ years in ML engineering, experience deploying production ML systems, and familiarity with AI coding agents such as Cursor, Claude Code, Codex, Windsurf, or Gemini CLI.

Qualifications

  • 2+ years of professional machine learning engineering experience.
  • Experience building production ML systems, deployment infra, or AI-powered products.
  • Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI.
  • Ability to evaluate model-generated ML implementations and tradeoffs.
  • Experience deploying ML systems to production is preferred.

Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex ML tasks.
  • Review model-generated implementations involving training, inference, and MLOps.
  • Identify bugs, edge cases, performance issues, and failure modes.
  • Compare outputs from multiple frontier models and assess strengths and weaknesses.
  • Apply professional engineering judgment to realistic ML scenarios.

Skills

ML engineering
Production ML systems
AI coding agents
ML model evaluation

Tools

Cursor
Claude Code
Codex
Windsurf
Gemini CLI

Job description

Obsidian is seeking contributors to support a Frontier Code Agents project with focus on realistic ML engineering workflows and model evaluation. You will analyze model-generated code, assess training and deployment considerations, and identify issues across multiple frontier models.

Applicants should have 2+ years in ML engineering, experience deploying production ML systems, and familiarity with AI coding agents such as Cursor, Claude Code, Codex, Windsurf, or Gemini CLI.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Frontier ML Engineer: AI Coding Agent Evaluator
Frontier ML Engineer: AI Coding Agent Evaluator

Obsidian • New York (NY)

Hybrid
Frontier AI ML Engineer — Evaluation & Production Systems
Frontier AI ML Engineer — Evaluation & Production Systems

Obsidian • New York (NY)

Remote
USD 4,000 - 7,000
Frontier AI Code Engineer — ML Systems & Evaluation
Frontier AI Code Engineer — ML Systems & Evaluation

Mercor • New York (NY)

On-site
USD 179,000 - 276,000
AI Code-Agent Evaluator: Frontier DevOps Engineer
AI Code-Agent Evaluator: Frontier DevOps Engineer

Obsidian • New York (NY)

On-site
USD 455,000 - 647,000
ML Engineer - Coding Agent Expert
ML Engineer - Coding Agent Expert

Obsidian • New York (NY)

Hybrid
Frontier Cloud Engineer: AI Coding Agents
Frontier Cloud Engineer: AI Coding Agents

Obsidian • New York (NY)

Remote
USD 551,000 - 1,102,000
Backend Engineer: AI Coding Agent Evaluator
Backend Engineer: AI Coding Agent Evaluator

Obsidian • New York (NY)

On-site
AI-Driven Data Engineer - Frontier Pipeline Evaluator
AI-Driven Data Engineer - Frontier Pipeline Evaluator

Obsidian • New York (NY)

Remote
USD 193,000 - 248,000
ML Engineer - AI Coding Expert
ML Engineer - AI Coding Expert

Mercor • New York (NY)

On-site
USD 179,000 - 276,000
Frontier AI ML Engineer — Real-World Model Evaluator
Frontier AI ML Engineer — Real-World Model Evaluator

Great Value Hiring • United States

On-site