ML Engineer: Frontier AI Code Agent Evaluator

Obsidian; Chicago (IL); On-site; USD 454,608 - 647,472; Part time

Job summary

Obsidian is seeking skilled professionals to support its Frontier Code Agents project in Chicago. The role involves evaluating and improving frontier AI coding models through technical assessments, tackling complex machine learning and AI engineering tasks.

Responsibilities include reviewing AI-generated implementations and identifying bugs or performance issues. Candidates should have over 2 years of experience in machine learning engineering and familiarity with AI coding tools. Compensation is based on completed tasks, offering $400 per accepted job.

Qualifications

• 2+ years of professional machine learning engineering experience.
• Experience building production ML systems, model deployment infrastructure, LLM applications, or AI-powered products.
• Regular use of AI coding agents such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.

Responsibilities

• Use frontier AI coding agents to complete and evaluate complex machine learning and AI engineering tasks.
• Review model-generated implementations involving model training, inference systems, MLOps, and LLM applications.
• Identify bugs, edge cases, performance issues, and failure modes.
• Compare outputs from multiple frontier models and assess their strengths and weaknesses.
• Apply professional engineering judgment to realistic ML engineering scenarios.

Job description

Obsidian is seeking skilled professionals to support its Frontier Code Agents project in Chicago. The role involves evaluating and improving frontier AI coding models through technical assessments, tackling complex machine learning and AI engineering tasks.

Responsibilities include reviewing AI-generated implementations and identifying bugs or performance issues. Candidates should have over 2 years of experience in machine learning engineering and familiarity with AI coding tools. Compensation is based on completed tasks, offering $400 per accepted job.