Founding RL Engineer: Environments & Data

CGS

San Francisco (CA)

On-site

USD 150,000 - 230,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Unlimited AI spend
Daily lunch provided
Equity—meaningful

Job summary

CGS in San Francisco is seeking a Founding Engineer focused on RL Environments & Data to turn real-world agent failures into simulated environments and evaluation benchmarks. You will build simulated business software environments and tools to measure task completion, connecting production performance with model training.

This is a founder-level, hands-on role with two founding engineering hires; ownership of RL environments, datasets, and evaluation strategy; deep collaboration with founders;

Qualifications

  • 1+ years of relevant experience.
  • Concrete example of building or contributing to an RL environment, benchmark, dataset or model evaluation system.
  • Experience with synthetic data, post-training or model evaluation.
  • Ability to simulate business software environments that can withstand complex agent tool interactions.
  • Experience designing graders and evaluations robust against reward hacking.
  • Strong programming and problem-solving skills.
  • Willingness to work full-time in person in San Francisco, Monday to Friday.

Responsibilities

  • Analyse real agent interaction traces to identify meaningful model failures.
  • Build realistic simulated business environments including email inboxes, CRMs, databases, records and file systems.
  • Develop reinforcement learning environments, benchmarks and evaluation systems.
  • Design robust graders that accurately measure task completion and resist reward hacking.
  • Create synthetic datasets and support post-training workflows.
  • Build evaluations whose rankings correlate with real-world production performance.
  • Identify weaknesses in existing benchmarks and develop better measurement methods.
  • Turn research and production insights into environments and datasets for AI labs.

Skills

RL environments
Programming
Problem-solving
Model evaluation
Synthetic data
Datasets

Job description

CGS in San Francisco is seeking a Founding Engineer focused on RL Environments & Data to turn real-world agent failures into simulated environments and evaluation benchmarks. You will build simulated business software environments and tools to measure task completion, connecting production performance with model training.

This is a founder-level, hands-on role with two founding engineering hires; ownership of RL environments, datasets, and evaluation strategy; deep collaboration with founders;

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Engineer – RL Environments & Data
Founding Engineer – RL Environments & Data

CGS • San Francisco (CA)

On-site
USD 150,000 - 230,000
Unlimited AI spend
Daily lunch provided
Equity—meaningful
Founding ML Engineer — RL Environments for Hardware AI
Founding ML Engineer — RL Environments for Hardware AI

Rnb Consultancy • San Francisco (CA)

On-site
USD 150,000 - 250,000
Equity
Founding role
Founding RL Environments Engineer - Benchmarks & Evals
Founding RL Environments Engineer - Benchmarks & Evals

Rnb Consultancy • San Francisco (CA)

On-site
USD 150,000 - 200,000
Base salary $150k–$200k
Equity 0.25–0.5%
Profit sharing up to 4% of project
+1
Staff RL Environments Engineer
Staff RL Environments Engineer

Scale AI, Inc. • San Francisco (CA)

On-site
USD 252,000 - 315,000
Health coverage
Dental coverage
Vision coverage
+4
Staff Research Engineer — RL Environments Lead
Staff Research Engineer — RL Environments Lead

Turing • San Francisco (CA)

On-site
USD 250,000 - 400,000
Amazing work culture
Awesome colleagues
Competitive compensation
Senior RL Environment Engineer — Real-World Data Systems
Senior RL Environment Engineer — Real-World Data Systems

Replay • New York (NY)

On-site
USD 220,000 - 320,000
Base salary $220–320K
Equity
Medical, dental, and vision insurance
+4
RL Environment Software Engineer – AfterQuery
RL Environment Software Engineer – AfterQuery

talentpluto • San Francisco (CA)

On-site
USD 180,000 - 220,000
Staff Engineer, RL Environments & Data Platforms
Staff Engineer, RL Environments & Data Platforms

Zendo Labs • New York (NY)

Hybrid
USD 180,000 - 260,000
Equity compensation
Comprehensive benefits
Software Engineer - RL Environments San Francisco
Software Engineer - RL Environments San Francisco

AfterQuery • San Francisco (CA)

On-site
USD 160,000 - 210,000
Equity
Growth opportunities
Founding Head of RL & Post-Training Strategy
Founding Head of RL & Post-Training Strategy

FOUND • West Hollywood (CA)

On-site
USD 220,000 - 360,000