Staff Engineer, AI Environments & Evaluations

Remanence

Paris (TX)

Hybrid

USD 102,000 - 147,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Visa sponsorship
Relocation support
Hybrid work

Job summary

Remanence is building the next era of enterprise AI with high-fidelity simulations and adaptive curricula to train and evaluate agents in realistic environments. You will help design reproducible systems and evaluators that ensure learning transfers to real deployments.

The team prioritizes first principles, experimentation, and rapid iteration, aiming to deliver scalable, safe, and reliable AI training loops across complex workflows.

Qualifications

  • Strong engineering fundamentals with experimental judgment.
  • Curiosity about model behavior and real-world deployment.
  • Experience with synthetic data, world models, agents, curriculum learning, or evaluation is valuable.

Responsibilities

  • Build pipelines that generate tasks, initial states, tool configurations, and verifiers; filter for validity, diversity, and difficulty.
  • Develop curriculum strategies that select and generate tasks based on model failures, learning progress, and gaps in capability coverage.
  • Train learned simulators from deployment traces to model user behavior, tool responses, and environment dynamics; validate fidelity.
  • Build reproducible evaluation harnesses and held-out tests that detect reward exploitation, simulator shortcuts, contamination, and failures to generalize.

Skills

Engineering mindset
Experimental judgment
Curiosity about model behavior
First principles thinking
Synthetic data
World models
Agents
Curriculum learning
Evaluation

Tools

PyTorch
Transformers
vLLM
SGLang
Ray
Docker
OpenEnv
Gymnasium
Playwright
Apache Parquet
LanceDB
DVC

Job description

Remanence is building the next era of enterprise AI with high-fidelity simulations and adaptive curricula to train and evaluate agents in realistic environments. You will help design reproducible systems and evaluators that ensure learning transfers to real deployments.

The team prioritizes first principles, experimentation, and rapid iteration, aiming to deliver scalable, safe, and reliable AI training loops across complex workflows.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff — Environments / Evals
Member of Technical Staff — Environments / Evals

Remanence • Paris (TX)

Hybrid
USD 102,000 - 147,000
Visa sponsorship
Relocation support
Hybrid work
RL Environment Engineer for Real Enterprise Data
RL Environment Engineer for Real Enterprise Data

Sunset • New York (NY)

On-site
USD 220,000 - 320,000
Meaningful equity
Medical, dental & vision
Unlimited PTO
+3
AI Evaluation Engineer: RL Environments & Agents
AI Evaluation Engineer: RL Environments & Agents

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 210,000
Research Engineer: RL Environments & Evaluation Systems
Research Engineer: RL Environments & Evaluation Systems

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 170,000 - 250,000
Staff Engineer, Enterprise AI Systems
Staff Engineer, Enterprise AI Systems

Ambral • United States

On-site
USD 140,000 - 175,000
Equity ownership
Equinox membership
Free meals, coffee, and snacks
+2
Senior RL Environment Engineer — Real-World Data Systems
Senior RL Environment Engineer — Real-World Data Systems

Replay • New York (NY)

On-site
USD 220,000 - 320,000
Base salary $220–320K
Equity
Medical, dental, and vision insurance
+4
Staff Engineer – Enterprise AI Evaluation & Automation
Staff Engineer – Enterprise AI Evaluation & Automation

Perplexity AI • New York (NY)

On-site
USD 150,000 - 230,000
RL Environments Engineer
RL Environments Engineer

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 200,000
Senior Software Engineer, AI RL Environments
Senior Software Engineer, AI RL Environments

Mechanize • San Francisco (CA)

On-site
USD 150,000 - 230,000
Health insurance
Dental insurance
Vision insurance
+1
RL Environments & Evaluation Infrastructure Engineer
RL Environments & Evaluation Infrastructure Engineer

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 200,000