Frontier Coding Data Engineer — Evaluation & Training

Surge AI

United States

Remote

USD 140,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Surge AI seeks a Research Engineer focused on Coding Evaluation and Training Data to design, run, and optimize data-driven tasks that teach frontier models how to code. You will own projects end-to-end, crafting tasks, RL environments, and evaluation schemes that reflect real-world software engineering challenges.

You will work with client engineers and Surge teams to translate high-level goals into concrete data workflows, tools, and environments, ensuring high-quality results.

Qualifications

  • 3–6+ years of professional software engineering experience.
  • Strong coding ability in at least one mainstream language.
  • High taste for correct, high-quality engineering and production code.
  • Ability to reason about and debug technical environments including containers, dependencies, and automation.
  • Interest in owning projects end-to-end from scoping to execution and improvement.
  • Excellent communication skills to speak credibly with senior client engineers.

Responsibilities

  • Own end-to-end coding data projects from scoping and pilot design through execution and scale-up.
  • Design agentic training workflows and task structures reflecting real-world SWE work.
  • Define rubrics, golden sets, and reward signals that capture engineering value.
  • Evaluate data and worker output against technical standards.
  • Design and run qualification processes for coding workers.
  • Set up complex environments (containers, repos, test harnesses, sandboxes, code execution infra).
  • Collaborate with Surge engineering, product, and operations to improve coding data products.

Skills

Software engineering
Production code
Code review
Debugging
Communication
AI/ML systems

Tools

Containers
Test harnesses
Code execution infra

Job description

Surge AI seeks a Research Engineer focused on Coding Evaluation and Training Data to design, run, and optimize data-driven tasks that teach frontier models how to code. You will own projects end-to-end, crafting tasks, RL environments, and evaluation schemes that reflect real-world software engineering challenges.

You will work with client engineers and Surge teams to translate high-level goals into concrete data workflows, tools, and environments, ensuring high-quality results.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer - Coding Data & Evaluation for Frontier AI
Software Engineer - Coding Data & Evaluation for Frontier AI

Surge AI • United States

Remote
USD 110,000 - 180,000
Research Engineer, Coding Evaluation & Training Data
Research Engineer, Coding Evaluation & Training Data

Surge AI • United States

Remote
USD 140,000 - 210,000
Software Engineer, Coding Evaluation & Training Data
Software Engineer, Coding Evaluation & Training Data

Surge AI • United States

Remote
USD 110,000 - 180,000
Frontier AI Evaluation Engineer (RL & Data Pipelines)
Frontier AI Evaluation Engineer (RL & Data Pipelines)

Prime Intellect, Inc. • San Francisco (CA)

Hybrid
USD 150,000 - 350,000
Cash compensation range
Remote or on-site SF office
Visa sponsorship
+1
Staff Research Engineer, Frontier AI & Evaluation Systems
Staff Research Engineer, Frontier AI & Evaluation Systems

Dover • California

On-site
USD 180,000 - 240,000
Data Engineer (Coding Agent Experience)
Data Engineer (Coding Agent Experience)

Mercor • United States

Remote
USD 183,000 - 276,000
Senior AI Research Engineer – Frontier Models & RL
Senior AI Research Engineer – Frontier Models & RL

turing • United States

Remote
USD 250,000 - 350,000
Coding Research Evaluation Engineer
Coding Research Evaluation Engineer

Remotebridge • United States

Remote
USD 200,000 - 260,000
Equity compensation
Bonus eligibility
Health-insurance reimbursement
+2
Remote AI Evaluation Architect | Frontier ML Systems
Remote AI Evaluation Architect | Frontier ML Systems

Crossing Hurdles • United States

Remote
USD 240,000 - 350,000
Lead AI Data & RL Engineer for Coding Agents
Lead AI Data & RL Engineer for Coding Agents

Turing • San Francisco (CA)

On-site
USD 250,000 - 350,000
Competitive compensation
Equity opportunities
Collaborative culture