Remote Machine Learning Evaluation Engineer

OpenTrain AI, Inc.

United States

Remote

USD 138,000 - 207,000

Part time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Remote work
Flexible schedule
Portfolio building

Job summary

OpenTrain is seeking a Machine Learning Engineering Evaluator for a part-time, fully remote contractor role around 15 hours per week. You will develop and review ML models, pipelines, and evaluation systems using Python, PyTorch, and JAX, delivering rigorous technical assessments and documented trade-offs.

Flexible weekends may be available. The ideal candidate holds a Masters or PhD in a quantitative field, has practical ML experience, and can build reproducible workflows while explaining

Qualifications

  • Advanced degree in a quantitative field; strong ML background.
  • Proven ability to build reproducible ML workflows.
  • Experience with multiple ML frameworks and inference tools.
  • Ability to diagnose and explain performance trade-offs clearly.

Responsibilities

  • Develop and validate ML models, training pipelines, and inference systems.
  • Build reproducible workflows using Python and command-line tools.
  • Analyze tensor operations, model architectures, and generation pipelines.
  • Optimize latency, memory usage, and hardware utilization.
  • Review AI-generated code and evaluate technical solutions.
  • Design objective tests, benchmarks, and evaluation criteria.
  • Document implementation choices, trade-offs, and failure modes.

Skills

Python proficiency
Debug ML systems
Explain trade-offs
Communication

Education

Master's or PhD in CS/ML

Tools

PyTorch
JAX
NumPy
Hugging Face

Job description

OpenTrain is seeking a Machine Learning Engineering Evaluator for a part-time, fully remote contractor role around 15 hours per week. You will develop and review ML models, pipelines, and evaluation systems using Python, PyTorch, and JAX, delivering rigorous technical assessments and documented trade-offs.

Flexible weekends may be available. The ideal candidate holds a Masters or PhD in a quantitative field, has practical ML experience, and can build reproducible workflows while explaining

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Engineering Evaluator
Machine Learning Engineering Evaluator

OpenTrain AI, Inc. • United States

Remote
USD 138,000 - 207,000
Remote work
Flexible schedule
Portfolio building
Remote ML Evaluation Architect (Part-Time)
Remote ML Evaluation Architect (Part-Time)

anyone-ai • United States

On-site
USD 83,000 - 124,000
Remote Senior AI/ML Engineer – LLM Training & Evaluation
Remote Senior AI/ML Engineer – LLM Training & Evaluation

Prolific • Milwaukee (WI)

On-site
USD 100,000 - 130,000
Competitive pay rates
Flexible hours
Ability to work from home
Machine Learning Expert - Fully Remote | Upto $90/hr
Machine Learning Expert - Fully Remote | Upto $90/hr

Obsidian • San Francisco (CA)

Hybrid
USD 120,000 - 160,000
Remote Full-Stack Engineer — AI Code Evaluation
Remote Full-Stack Engineer — AI Code Evaluation

OpenTrain AI, Inc. • United States

On-site
USD 69,000 - 138,000
Remote Machine Learning Engineer
Remote Machine Learning Engineer

Spotter Labs Inc • Lemont (IL)

Remote
USD 90,000 - 150,000
Fully remote work
Flexible working environment
Real-world AI projects
Senior Open-Source Engineer (Remote) – AI Task Evaluator
Senior Open-Source Engineer (Remote) – AI Task Evaluator

YO AI Labs • Washington

On-site
USD 83,000 - 124,000
Remote Freelance ML Task Auditor & AI Evaluation Specialist
Remote Freelance ML Task Auditor & AI Evaluation Specialist

Triwill Group • Northern (KY)

Hybrid
USD 83,000 - 165,000
Remote work
Remote Senior AI Evaluation Engineer
Remote Senior AI Evaluation Engineer

YO AI Labs • Atlanta (GA)

Remote
USD 165,000 - 220,000
Remote Contractor — AI Agent Evaluation Engineer
Remote Contractor — AI Agent Evaluation Engineer

YO AI Labs • Houston (TX)

Remote
USD 83,000 - 165,000