AI Systems Engineer: Frontier Model Evaluator

Obsidian

New York (NY)

On-site

USD 180,000 - 220,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Obsidian is seeking contributors for a project with a leading AI research lab. The role involves using frontier AI coding agents to finalize and assess complex engineering tasks.

Contributors will review code, identify bugs, and compare outputs from different models. Strong systems engineering experience is essential, coupled with familiarity with AI coding tools. Compensation is $400 per accepted task, with typical tasks lasting 2–3 hours.

Qualifications

  • 2+ years of professional systems engineering experience.
  • Regular use of AI coding agents.
  • Ability to evaluate model-generated systems designs.

Responsibilities

  • Complete and evaluate complex engineering tasks using AI tools.
  • Review model-generated code and architectures.
  • Identify bugs and performance bottlenecks.
  • Compare outputs from multiple models.

Skills

Systems engineering experience
Experience with distributed systems
Networking knowledge
Familiarity with AI coding agents
Scalable systems design

Tools

Cursor
Claude Code
Codex
Windsurf
Gemini CLI

Job description

Obsidian is seeking contributors for a project with a leading AI research lab. The role involves using frontier AI coding agents to finalize and assess complex engineering tasks.

Contributors will review code, identify bugs, and compare outputs from different models. Strong systems engineering experience is essential, coupled with familiarity with AI coding tools. Compensation is $400 per accepted task, with typical tasks lasting 2–3 hours.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Frontier ML Engineer: AI Coding Agent Evaluator
Frontier ML Engineer: AI Coding Agent Evaluator

Obsidian • New York (NY)

Hybrid
Backend Engineer: AI Coding Agent Evaluator
Backend Engineer: AI Coding Agent Evaluator

Obsidian • New York (NY)

On-site
AI Code-Agent Evaluator: Frontier DevOps Engineer
AI Code-Agent Evaluator: Frontier DevOps Engineer

Obsidian • New York (NY)

On-site
USD 455,000 - 647,000
Frontier AI Security Engineer (Code Agent Evaluator)
Frontier AI Security Engineer (Code Agent Evaluator)

Obsidian • New York (NY)

Remote
AI-Driven Data Engineer - Frontier Pipeline Evaluator
AI-Driven Data Engineer - Frontier Pipeline Evaluator

Obsidian • New York (NY)

Remote
USD 193,000 - 248,000
Security Engineer for Frontier AI Coding Agents
Security Engineer for Frontier AI Coding Agents

Obsidian • San Francisco (CA)

On-site
Frontier AI Risk Engineer - Fraud & Trust Safety Evaluator
Frontier AI Risk Engineer - Fraud & Trust Safety Evaluator

Obsidian • New York (NY)

Remote
Frontier AI ML Engineer — Evaluation & Production Systems
Frontier AI ML Engineer — Evaluation & Production Systems

Obsidian • New York (NY)

Remote
USD 4,000 - 7,000
Frontend Engineer: AI Coding Evaluator
Frontend Engineer: AI Coding Evaluator

Obsidian • New York (NY)

On-site
Frontier AI Security Engineer: Code Agent Vetting
Frontier AI Security Engineer: Code Agent Vetting

Obsidian • Chicago (IL)

On-site