Frontier AI Code Engineer — ML Systems & Evaluation

Mercor; New York (NY); On-site; USD 179,000 - 276,000; Full time

Job summary

Mercor partners with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments, focusing on realistic ML engineering workflows and model evaluation.

From sprint-based tasks to edge-case identification and performance reviews, you will use frontier AI coding agents to complete complex ML tasks, review model implementations, and compare outputs across frontier models.

Qualifications

• 2+ years of professional machine learning engineering experience.
• Experience building production ML systems, model deployment infrastructure, LLM applications, or AI-powered products.
• Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.
• Ability to evaluate model-generated machine learning implementations and technical tradeoffs.
• Experience deploying ML systems to production is preferred.

Responsibilities

• Use frontier AI coding agents to complete and evaluate complex machine learning and AI engineering tasks.
• Review model-generated implementations involving model training, inference systems, MLOps, and LLM applications.
• Identify bugs, edge cases, performance issues, and failure modes.
• Compare outputs from multiple frontier models and assess their strengths and weaknesses.
• Apply professional engineering judgment to realistic ML engineering scenarios.

Skills

ML engineering

Production ML systems

AI coding agents

Model evaluation

ML deployment

Tools

Cursor

Claude Code

Codex

Windsurf

Gemini CLI

Job description

Mercor partners with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments, focusing on realistic ML engineering workflows and model evaluation.

From sprint-based tasks to edge-case identification and performance reviews, you will use frontier AI coding agents to complete complex ML tasks, review model implementations, and compare outputs across frontier models.