Platform Engineer, RL & Eval Data | 100% remote

anyone-ai

United States

Remote

USD 150,000 - 230,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

anyone-ai is seeking an experienced software/ML engineer to own and extend production platforms used for AI evaluation tasks and data handling. You will collaborate across backend services, APIs, and infrastructure with task authors and reviewers to deliver reliable software for large workloads.

The role emphasizes strong Python backend work, API design, and distributed systems, plus TypeScript/React for internal tools. Fluency in English is required.

Qualifications

  • At least five years in software, data, or ML engineering, with recent experience in AI/ML data, model evaluation, annotation, or developer tooling.
  • A record of operating and maintaining production systems as well as building them.
  • Strong Python backend engineering, API and data-model design, and relational database skills such as schema changes and query tuning.
  • Enough TypeScript and React experience to build and maintain internal tools.
  • Experience with distributed systems for long-running jobs, orchestration and queues, containers, cloud infrastructure, and observability.
  • Security fundamentals, careful use of AI coding agents, initiative in ambiguous settings, and fluent English.

Responsibilities

  • Learn and maintain existing platforms: fix defects, reduce technical debt, and improve tests and documentation.
  • Design and deliver features across databases, backend services, APIs, and internal tools.
  • Scale systems for higher workloads with predictable performance and cost.
  • Build agent environments and supporting infrastructure, including isolated sandboxes, environment images, rollouts, and reward computation.
  • Maintain monitoring, alerting, incident response, access controls, client-data protections, and safe execution of untrusted code.
  • Create tools for task authors, reviewers, and project leads, including support for rapid sample production when needed.

Skills

Python backend
API design
Data modeling
TypeScript
React
Distributed systems
Cloud infra
Security basics
English fluency

Job description

Role overview

Own and extend production platforms used to create evaluation tasks, reinforcement-learning environments, and human-reviewed data for advanced AI work. You’ll work across backend services, internal tools, and infrastructure, partnering with task authors and reviewers to turn operational needs into reliable software that can handle much larger workloads.

Responsibilities
  • Learn and maintain existing platforms: fix defects, reduce technical debt, and improve tests and documentation.
  • Design and deliver features across databases, backend services, APIs, and internal tools.
  • Scale systems for higher workloads with predictable performance and cost.
  • Build agent environments and supporting infrastructure, including isolated sandboxes, environment images, rollouts, and reward computation.
  • Maintain monitoring, alerting, incident response, access controls, client-data protections, and safe execution of untrusted code.
  • Create tools for task authors, reviewers, and project leads, including support for rapid sample production when needed.
Requirements
  • At least five years in software, data, or ML engineering, with recent experience in AI/ML data, model evaluation, annotation, or developer tooling.
  • A record of operating and maintaining production systems as well as building them.
  • Strong Python backend engineering, API and data-model design, and relational database skills such as schema changes and query tuning.
  • Enough TypeScript and React experience to build and maintain internal tools.
  • Experience with distributed systems for long-running jobs, orchestration and queues, containers, cloud infrastructure, and observability.
  • Security fundamentals, careful use of AI coding agents, initiative in ambiguous settings, and fluent English.
Nice to have
  • Hands-on work with LLM-agent RL environments, sandboxing, high-volume rollouts, evaluation harnesses, graders, or reward functions.
  • Experience with annotation workflows, contributor quality control, or scaling manual data processes.
  • Contributions to open-source RL or evaluation projects, or tools for distributed contributor teams.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Platform Engineer, RL & Eval Data (Fully Remote)
Platform Engineer, RL & Eval Data (Fully Remote)

Anyone AI • United States

Remote
USD 120,000 - 180,000
Platform Engineer - RL & Evaluation Data Systems
Platform Engineer - RL & Evaluation Data Systems

anyone-ai • United States

Remote
USD 150,000 - 230,000
Staff Engineer, RL Environments & Data Platforms
Staff Engineer, RL Environments & Data Platforms

Zendo Labs • New York (NY)

Hybrid
USD 180,000 - 260,000
Equity compensation
Comprehensive benefits
Research Engineer, RL Environments and Infrastructure
Research Engineer, RL Environments and Infrastructure

Hyphen Connect • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Member of Technical Staff: Core AI Platform
Member of Technical Staff: Core AI Platform

Lightspeed AI, Inc. • Seattle (WA)

Hybrid
USD 180,000 - 240,000
AI Infrastructure Engineer
AI Infrastructure Engineer

Pokee AI • United States

Remote
USD 140,000 - 220,000
Member of Technical Staff
Member of Technical Staff

Murphy Talent Group • San Francisco (CA)

On-site
USD 160,000 - 420,000
Equity
Benefits
Member of Technical Staff
Member of Technical Staff

Zendo Labs • New York (NY)

Hybrid
USD 180,000 - 260,000
Equity compensation
Comprehensive benefits
Research Engineer | Remote
Research Engineer | Remote

Crossing Hurdles • United States

Remote
USD 400,000 - 800,000
ML Engineer
ML Engineer

RustLabs • Connecticut

On-site
USD 120,000 - 165,000