Software Engineer - Coding Data & Evaluation for Frontier AI

Surge AI

United States

A distancia

USD 110.000 - 180.000

Jornada completa

14 días+

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Surge AI is seeking a Software Engineer, Coding Evaluation & Training Data to join the team at Surge AI, working at the intersection of software engineering and product to build systems that teach frontier models how to code.

You’ll own end-to-end coding data projects, design agentic training workflows, and define evaluation rubrics that reflect real-world software engineering value, shaping data products for clients and internal tools.

Formación

  • 2–6+ years of professional software engineering experience building and maintaining real systems.
  • Strong coding ability in at least one mainstream language and comfort working in production codebases.
  • High taste for good engineering: you care about correctness, code quality, and how real engineering teams actually work.
  • Ability to reason about and debug technical environments, including containers, dependencies, and automated test setups.
  • Interest in owning projects end-to-end, including scoping, workflow design, execution, and continuous improvement.
  • Excellent written and verbal communication skills, with the ability to speak credibly with senior client engineers and translate fuzzy goals into actionable plans.
  • Excitement about AI/ML systems and the role of data, evaluation, and reward design in improving agentic coding capabilities.

Responsabilidades

  • Own end-to-end coding data projects, from initial scoping and pilot design through execution, iteration, and scale-up.
  • Design agentic training workflows and task structures that mirror real-world SWE work (e.g., refactoring, debugging, code review, large-repo navigation, tool use).
  • Define and iterate on rubrics, golden sets, and reward signals that capture true engineering value, not just "does it compile."
  • Evaluate data and worker output with strong SWE taste, and make calls about what meets the bar for frontier training.
  • Design and run qualification processes for coding workers, including hands-on assessments of their coding ability.
  • Set up or partner on complex technical environments (e.g., containers, repos, test harnesses, sandboxes, code execution infrastructure).
  • Partner with technical staff at our clients to translate high-level training goals into concrete projects and technical environments.
  • Collaborate closely with Surge engineering, product, and operations to improve our coding data products, internal tools, and execution processes.

Conocimientos

Software engineering
Production codebases

Descripción del empleo

Surge AI is seeking a Software Engineer, Coding Evaluation & Training Data to join the team at Surge AI, working at the intersection of software engineering and product to build systems that teach frontier models how to code.

You’ll own end-to-end coding data projects, design agentic training workflows, and define evaluation rubrics that reflect real-world software engineering value, shaping data products for clients and internal tools.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Frontier Coding Data Engineer — Evaluation & Training
Frontier Coding Data Engineer — Evaluation & Training

Surge AI • EE. UU.

A distancia
USD 140.000 - 210.000
Software Engineer, Coding Evaluation & Training Data
Software Engineer, Coding Evaluation & Training Data

Surge AI • EE. UU.

A distancia
USD 110.000 - 180.000
Research Engineer, Coding Evaluation & Training Data
Research Engineer, Coding Evaluation & Training Data

Surge AI • EE. UU.

A distancia
USD 140.000 - 210.000
AI Code Evaluation Engineer – Frontend & Backend
AI Code Evaluation Engineer – Frontend & Backend

HumanitApp • San Francisco (CA)

Presencial
USD 83.000 - 138.000
AI Code Evaluator & Software Engineer (Contractor)
AI Code Evaluator & Software Engineer (Contractor)

Aitrainergigs • San Francisco (CA), Town of Belgium (WI)

Híbrido
USD 55.000 - 117.000
Staff Product Engineer
Staff Product Engineer

Surge AI • EE. UU.

A distancia
USD 180.000 - 240.000
Staff Fullstack Engineer: Own & Build Core AI Platform
Staff Fullstack Engineer: Own & Build Core AI Platform

Surge AI • EE. UU.

A distancia
USD 180.000 - 280.000
Frontier AI Evaluation Scientist — Equity & Growth
Frontier AI Evaluation Scientist — Equity & Growth

AfterQuery • San Francisco (CA)

Presencial
USD 150.000 - 230.000
Health Insurance
401(k) with Employer Match
Daily Meals: UberEats stipend
+1
Staff Research Engineer, Frontier AI & Evaluation Systems
Staff Research Engineer, Frontier AI & Evaluation Systems

Dover • California

Presencial
USD 180.000 - 240.000
Staff Fullstack Engineer
Staff Fullstack Engineer

Surge AI • EE. UU.

A distancia
USD 180.000 - 280.000