Remote ML QA Engineer: Code Review & Bug Diagnosis

AuraOne Human Data

United States

Remote

USD 83,000 - 138,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking an ML/AI Systems Engineer on a remote engineering review track. You will evaluate production code, debug traces, and model outputs for correctness, writing tests and rationales to guide improvements.

You’ll reproduce failures in a sandbox, draft minimal tests for edge cases, and compare paired solutions with clear justifications to help the modeling team close gaps.

Qualifications

  • Experience reading, running, and debugging unfamiliar code for ML/AI systems.
  • Ability to write concise unit tests capturing a single failure mode.
  • Familiarity with a testing framework (pytest/Jest/JUnit/Go test/RSpec).

Responsibilities

  • Run and reproduce candidate code outputs in a sandboxed environment for assignments.
  • Grade ml/ai systems engineer engineering review solutions for correctness, style, and edge-case handling.
  • Write minimal failing tests that demonstrate the bug a model output missed.
  • Compare paired solutions and rank them with a written rationale tied to the rubric.
  • Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
  • Document recurring code-generation failures so the modeling team can target them.
  • Calibrate against gold-standard reviews to keep inter-rater agreement above target.

Skills

Code review
Debugging
Unit testing
Software engineering judgment
ML/AI Systems Engineer engineering rev
Machine Learning
Python
ML/Data Engineering

Tools

pytest
Jest
JUnit
Go test
RSpec

Job description

AuraOne, Inc. is seeking an ML/AI Systems Engineer on a remote engineering review track. You will evaluate production code, debug traces, and model outputs for correctness, writing tests and rationales to guide improvements.

You’ll reproduce failures in a sandbox, draft minimal tests for edge cases, and compare paired solutions with clear justifications to help the modeling team close gaps.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote ML Code Reviewer & Debugger
Remote ML Code Reviewer & Debugger

AuraOne Human Data • United States

Remote
USD 55,000 - 124,000
Remote ML QA Engineer — Model Evaluation & Debugging
Remote ML QA Engineer — Model Evaluation & Debugging

AuraOne Human Data • United States

Remote
USD 124,000 - 193,000
AI/ML Code Review Engineer — Internal Platforms (Remote)
AI/ML Code Review Engineer — Internal Platforms (Remote)

AuraOne Human Data • United States

Remote
USD 55,000 - 110,000
Remote Code Review Engineer — AI & Production Debugging
Remote Code Review Engineer — AI & Production Debugging

Auraone • United States

Remote
USD 148,000 - 210,000
AI/ML Code Reviewer — Internal Platforms (Remote)
AI/ML Code Reviewer — Internal Platforms (Remote)

Auraone • United States

Remote
USD 148,000 - 210,000
Remote Junior Software Engineer — Code Review & QA
Remote Junior Software Engineer — Code Review & QA

Auraone • United States

Remote
USD 148,000 - 210,000
Remote work
Hourly pay
Remote Software AI Engineer — Code Review & Debugging
Remote Software AI Engineer — Code Review & Debugging

Auraone • United States

Remote
USD 148,000 - 210,000
Remote ML Engineer — AI Research & Model Evaluation
Remote ML Engineer — AI Research & Model Evaluation

Move2usajobs • United States

Remote
USD 28,000 - 207,000
Remote Code-Review Engineer (Junior)
Remote Code-Review Engineer (Junior)

AuraOne, Inc. • United States

Remote
USD 55,000 - 110,000
Senior Software Engineer, AI Data QA & Review (Remote)
Senior Software Engineer, AI Data QA & Review (Remote)

AuraOne Human Data • United States

Remote
USD 170,000 - 243,000