ML/AI Systems Engineer

AuraOne Human Data

United States

À distance

USD 83 000 - 138 000

Plein temps

Il y a 2 jours
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

AuraOne, Inc. is seeking an ML/AI Systems Engineer on a remote engineering review track. You will evaluate production code, debug traces, and model outputs for correctness, writing tests and rationales to guide improvements.

You’ll reproduce failures in a sandbox, draft minimal tests for edge cases, and compare paired solutions with clear justifications to help the modeling team close gaps.

Qualifications

  • Experience reading, running, and debugging unfamiliar code for ML/AI systems.
  • Ability to write concise unit tests capturing a single failure mode.
  • Familiarity with a testing framework (pytest/Jest/JUnit/Go test/RSpec).

Responsabilités

  • Run and reproduce candidate code outputs in a sandboxed environment for assignments.
  • Grade ml/ai systems engineer engineering review solutions for correctness, style, and edge-case handling.
  • Write minimal failing tests that demonstrate the bug a model output missed.
  • Compare paired solutions and rank them with a written rationale tied to the rubric.
  • Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
  • Document recurring code-generation failures so the modeling team can target them.
  • Calibrate against gold-standard reviews to keep inter-rater agreement above target.

Connaissances

Code review
Debugging
Unit testing
Software engineering judgment
ML/AI Systems Engineer engineering rev
Machine Learning
Python
ML/Data Engineering

Outils

pytest
Jest
JUnit
Go test
RSpec

Description du poste

ML/AI Systems Engineer is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should have written, and explain the fix so the modeling team can target the gap.

Why this role matters

Engineering model quality lives or dies on whether the generated code actually compiles, passes tests, and handles edge cases. AuraOne pairs experienced engineers with the modeling team to grade outputs the way a code reviewer would.

Responsibilities
  • Run and reproduce candidate code outputs in a sandboxed environment for ML/AI Systems Engineer assignments.
  • Grade ml/ai systems engineer engineering review solutions for correctness, style, and edge-case handling.
  • Write minimal failing tests that demonstrate the bug a model output missed.
  • Compare paired solutions and rank them with a written rationale tied to the rubric.
  • Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
  • Document recurring code-generation failures so the modeling team can target them.
  • Calibrate against gold-standard reviews to keep inter-rater agreement above target.
Qualifications
  • Strong day-job engineering experience — you can read, run, and debug unfamiliar code for ML/AI Systems Engineer work.
  • Comfort writing concise unit tests that capture a single failure mode.
  • Familiarity with a testing framework. pytest, Jest, or JUnit. Go test, RSpec, or whatever you use.
  • Clear written reasoning — your review note has to convince another senior engineer.
  • Reliable async availability for at least 10 hours per week.
  • Prior code-review or technical-interview-grading experience is a plus.
Example tasks
  • Reproduce a generated engineering solution to a coding task, run the test suite, and grade it.
  • Write the smallest failing test that demonstrates a model's edge-case bug.
  • Compare two paired solutions and rank them with a written rationale tied to the rubric.
  • Triage a security issue surfaced by a model and document the patch the model should have produced.
Nice to have
  • Open-source contributions or a public portfolio that demonstrates production-quality code.
  • Experience with the target language's standard tooling, linters, and idiomatic style guides.
  • Familiarity with security-review checklists (OWASP, CWE) and AppSec patterns.
Skills
  • Code review
  • Debugging
  • Unit testing
  • Software engineering judgment
  • ML/AI Systems Engineer engineering review
  • Machine Learning
  • Python
  • ML/Data Engineering
Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Strong day-job engineering experience — you can read, run, and debug unfamiliar code for ML/AI Systems Engineer work. Comfort writing concise unit tests that capture a single failure mode. Familiarity with a testing framework. pytest, Jest, or JUnit. Go test, RSpec, or whatever you use. Clear written reasoning — your review note has to convince another senior engineer. Reliable async availability for at least 10 hours per week. Prior code-review or technical-interview-grading experience is a plus.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

AI/ML Engineer, Internal Platforms
AI/ML Engineer, Internal Platforms

AuraOne, Inc. • États-Unis

À distance
USD 55 000 - 110 000
Scientific / ML Engineer — AI Research and Model Evaluation
Scientific / ML Engineer — AI Research and Model Evaluation

AuraOne Human Data • États-Unis

À distance
USD 124 000 - 193 000
AI/ML Engineer
AI/ML Engineer

Auraone • États-Unis

À distance
USD 165 000 - 193 000
Remote work
AI Trainer, Machine Learning Engineering Review (Remote)
AI Trainer, Machine Learning Engineering Review (Remote)

AuraOne Human Data • États-Unis

À distance
USD 55 000 - 124 000
ML Engineer - LLM & Agentic Evaluations
ML Engineer - LLM & Agentic Evaluations

AuraOne Human Data • États-Unis

À distance
USD 83 000 - 165 000
AI/ML Engineer, Internal Platforms
AI/ML Engineer, Internal Platforms

Auraone • États-Unis

À distance
USD 148 000 - 210 000
Principal / Lead Systems Engineer — AI Systems Review
Principal / Lead Systems Engineer — AI Systems Review

AuraOne Human Data • États-Unis

À distance
USD 83 000 - 152 000
MBSE Engineer (SysML V2) - AI Evaluation
MBSE Engineer (SysML V2) - AI Evaluation

AuraOne Human Data • États-Unis

À distance
USD 55 000 - 103 000
Remote Full Stack Engineer - AI Code Review
Remote Full Stack Engineer - AI Code Review

AuraOne Human Data • États-Unis

À distance
USD 83 000 - 131 000
Senior Software Engineer - AI Data Evaluation
Senior Software Engineer - AI Data Evaluation

AuraOne Human Data • États-Unis

À distance
USD 68 000 - 97 000