Staff Engineer, AI Environments & Evaluations

Remanence

Paris (TX)

Hybrid

USD 102,000 - 147,000

Full time

12 days ago
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Visa sponsorship
Relocation support
Hybrid work

Job summary

Remanence is building the next era of enterprise AI with high-fidelity simulations and adaptive curricula to train and evaluate agents in realistic environments. You will help design reproducible systems and evaluators that ensure learning transfers to real deployments.

The team prioritizes first principles, experimentation, and rapid iteration, aiming to deliver scalable, safe, and reliable AI training loops across complex workflows.

Qualifications

  • Strong engineering fundamentals with experimental judgment.
  • Curiosity about model behavior and real-world deployment.
  • Experience with synthetic data, world models, agents, curriculum learning, or evaluation is valuable.

Responsibilities

  • Build pipelines that generate tasks, initial states, tool configurations, and verifiers; filter for validity, diversity, and difficulty.
  • Develop curriculum strategies that select and generate tasks based on model failures, learning progress, and gaps in capability coverage.
  • Train learned simulators from deployment traces to model user behavior, tool responses, and environment dynamics; validate fidelity.
  • Build reproducible evaluation harnesses and held-out tests that detect reward exploitation, simulator shortcuts, contamination, and failures to generalize.

Skills

Engineering mindset
Experimental judgment
Curiosity about model behavior
First principles thinking
Synthetic data
World models
Agents
Curriculum learning
Evaluation

Tools

PyTorch
Transformers
vLLM
SGLang
Ray
Docker
OpenEnv
Gymnasium
Playwright
Apache Parquet
LanceDB
DVC

Job description

Remanence is building the next era of enterprise AI with high-fidelity simulations and adaptive curricula to train and evaluate agents in realistic environments. You will help design reproducible systems and evaluators that ensure learning transfers to real deployments.

The team prioritizes first principles, experimentation, and rapid iteration, aiming to deliver scalable, safe, and reliable AI training loops across complex workflows.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff — Environments / Evals
Member of Technical Staff — Environments / Evals

Remanence • Paris (TX)

Hybrid
USD 102,000 - 147,000
Visa sponsorship
Relocation support
Hybrid work
Staff Engineer, RL Environments & AI Agents
Staff Engineer, RL Environments & AI Agents

Cohere • United States

Remote
USD 180,000 - 240,000
Staff Engineer: Enterprise AI Systems & Environments
Staff Engineer: Enterprise AI Systems & Environments

Ambral • New York (NY)

On-site
USD 120,000 - 190,000
Significant equity and ownership
Equinox membership
Free meals, coffee, and snacks
+2
Remote Senior Software Engineer: AI Agent Evaluation
Remote Senior Software Engineer: AI Agent Evaluation

YO AI Labs • Washington

Remote
USD 60,000 - 90,000
Senior AI Engineer - RL Environments for Codebase (Remote)
Senior AI Engineer - RL Environments for Codebase (Remote)

YO AI Labs • California (MO)

Remote
USD 83,000 - 124,000
Remote Senior Software Engineer — AI Training Environments
Remote Senior Software Engineer — AI Training Environments

YO AI Labs • San Jose (CA)

Remote
USD 83,000 - 152,000
Senior Software Engineer - RL Environments (Remote)
Senior Software Engineer - RL Environments (Remote)

YO AI Labs • Boston (MA)

Remote
USD 83,000 - 138,000
Remote work
Senior Software Engineer - AI/ML Environments (Remote)
Senior Software Engineer - AI/ML Environments (Remote)

YO AI Labs • Phoenix (AZ)

Remote
USD 83,000 - 165,000
Senior Software Engineer — AI Training Environments (Remote)
Senior Software Engineer — AI Training Environments (Remote)

YO AI Labs • California (MO)

Remote
USD 96,000 - 165,000
Remote AI Agent Evaluation Engineer
Remote AI Agent Evaluation Engineer

YO AI Labs • Los Angeles (CA)

Remote
USD 83,000 - 138,000