AI Systems Engineer: Frontier Model Evaluator

Obsidian

New York (NY)

On-site

USD 180,000 - 220,000

Full time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Obsidian is seeking contributors for a project with a leading AI research lab. The role involves using frontier AI coding agents to finalize and assess complex engineering tasks.

Contributors will review code, identify bugs, and compare outputs from different models. Strong systems engineering experience is essential, coupled with familiarity with AI coding tools. Compensation is $400 per accepted task, with typical tasks lasting 2–3 hours.

Qualifications

  • 2+ years of professional systems engineering experience.
  • Regular use of AI coding agents.
  • Ability to evaluate model-generated systems designs.

Responsibilities

  • Complete and evaluate complex engineering tasks using AI tools.
  • Review model-generated code and architectures.
  • Identify bugs and performance bottlenecks.
  • Compare outputs from multiple models.

Skills

Systems engineering experience
Experience with distributed systems
Networking knowledge
Familiarity with AI coding agents
Scalable systems design

Tools

Cursor
Claude Code
Codex
Windsurf
Gemini CLI

Job description

Obsidian is seeking contributors for a project with a leading AI research lab. The role involves using frontier AI coding agents to finalize and assess complex engineering tasks.

Contributors will review code, identify bugs, and compare outputs from different models. Strong systems engineering experience is essential, coupled with familiarity with AI coding tools. Compensation is $400 per accepted task, with typical tasks lasting 2–3 hours.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Systems Engineer: Frontier Code Agents Evaluator
AI Systems Engineer: Frontier Code Agents Evaluator

Obsidian • New York (NY)

Remote
USD 20,000 - 40,000
Frontier ML Engineer: AI Coding Agent Evaluator
Frontier ML Engineer: AI Coding Agent Evaluator

Mercor • New York (NY)

Hybrid
USD 275,520 - 826,560
Backend Engineer: AI Coding Agent Evaluator
Backend Engineer: AI Coding Agent Evaluator

Obsidian • New York (NY)

On-site
USD 454,608 - 647,472
ML Engineer: Frontier AI Code Agent Evaluator
ML Engineer: Frontier AI Code Agent Evaluator

Obsidian • Chicago (IL)

On-site
USD 454,608 - 647,472
AI Code-Agent Evaluator: Frontier DevOps Engineer
AI Code-Agent Evaluator: Frontier DevOps Engineer

Mercor • New York (NY)

On-site
USD 455,000 - 647,000
AI Coding Data Engineer for Frontier Model Evaluation
AI Coding Data Engineer for Frontier Model Evaluation

Mercor • New York (NY)

On-site
USD 454,608 - 647,472
AI-Driven DevOps Engineer & Model Evaluator
AI-Driven DevOps Engineer & Model Evaluator

Obsidian • San Francisco (CA)

On-site
USD 551,040 - 826,560
Frontier AI Security Engineer (Code Agent Evaluator)
Frontier AI Security Engineer (Code Agent Evaluator)

Obsidian • New York (NY)

Remote
USD 454,608 - 647,472
Security Engineer for Frontier AI Coding Agents
Security Engineer for Frontier AI Coding Agents

Obsidian • San Francisco (CA)

On-site
USD 275,520 - 551,040
AI-Driven Data Engineer - Frontier Pipeline Evaluator
AI-Driven Data Engineer - Frontier Pipeline Evaluator

Obsidian • New York (NY)

Remote
USD 193,000 - 248,000