Research Engineer, RL Environments and Infrastructure

Hyphen Connect

San Francisco (CA)

Hybrid

USD 180,000 - 240,000

Full time

7 days ago
Be an early applicant
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Hyphen Connect is seeking a hybrid Systems Engineer and AI Researcher to lead the design and implementation of our agent evaluation framework and post-training data pipelines.

You will architect sandboxed execution environments, high-throughput reinforcement learning feedback loops, and robust evaluation setups that handle non-deterministic agent outputs in enterprise settings. This role requires in-person collaboration at our SF office and a pragmatic problem-solving mindset.

Qualifications

  • Production AI evaluations, RL loops, or sandboxed environments deployed in production.
  • Proficiency in Python, Rust, C++, Go, TypeScript or CUDA; quick to pick up new tools.
  • On-site in San Francisco required.
  • Able to work with undocumented SDKs and distributed training setups.

Responsibilities

  • Build stateful agent environments with 50+ step trajectories.
  • Scale post-training and RL pipelines for dynamic policy optimization.
  • Design enterprise benchmarks to detect drift, hallucinations, and loops.
  • Optimize systems to minimize latency across distributed GPUs and sandboxes.

Skills

Production AI Experience
Systems Polyglot
Pragmatic Problem Solver

Tools

Python
Rust
C++
Go
TypeScript
CUDA

Job description

We are looking for a hybrid Systems Engineer and AI Researcher to lead the development of our agent evaluation framework and post-training data pipelines. You will design sandboxed execution environments, high-throughput reinforcement learning feedback loops, and robust evaluation setups that handle non-deterministic agent outputs.

Core Responsibilities
  • Build Stateful Agent Environments: Design deterministically verifiable, stateful sandboxes (web, OS, API, database) where agents can execute 50+ step action trajectories safely.
  • Scale Post-Training & RL Pipelines: Implement high-throughput post-training infrastructure (RLHF, Direct Preference Optimization, Process-Supervised Reward Models) for dynamic policy optimization.
  • Design Enterprise Benchmarks: Formulate evaluation metrics and automated grading harnesses that catch agent drift, hallucination, and loops in realistic enterprise environments.
  • Systems Optimization: Keep latency low and compute efficiency high across distributed GPUs and sandboxed runtime environments.
Requirements
  • Production AI Experience: Track record of deploying evaluations, RL loops, or sandboxed agent environments into production.
  • Systems Polyglot: Deep systems background (Python, Rust, C++, Go, TypeScript, CUDA)—you pick up new tools and frameworks within days.
  • San Francisco On-Site: In-person collaboration at our SF office to iterate quickly with founders and domain experts.
  • Pragmatic Problem Solver: Comfortable navigating raw paper implementations, undocumented SDKs, and custom distributed training setups.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Lab Tech Engineer
AI Lab Tech Engineer

Commergence • Colorado

Hybrid
USD 150,000 - 210,000
AI Lab Tech Engineer
AI Lab Tech Engineer

Commergence • Fremont (CA)

Hybrid
USD 120,000 - 180,000
Research Engineer
Research Engineer

Bespoke Labs • Mountain View (CA)

On-site
USD 120,000 - 140,000
Health coverage
Opportunity to work with leading AI labs
Competitive salary and equity
Backend Engineer
Backend Engineer

bespokelabs • Mountain View (CA)

On-site
USD 120,000 - 160,000
Health coverage
Competitive salary and equity
Opportunity to work with leading AI research labs
Backend Engineer
Backend Engineer

Bespoke Labs • Mountain View (CA)

On-site
USD 100,000 - 140,000
Health coverage
Opportunity to work with leading AI research labs
RL Environment Software Engineer
RL Environment Software Engineer

talentpluto • San Francisco (CA)

On-site
USD 180,000 - 220,000
AI Evaluation Engineer: RL Environments & Agents
AI Evaluation Engineer: RL Environments & Agents

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 210,000
Software Engineer
Software Engineer

Acceler8 Talent • San Francisco (CA)

On-site
USD 225,000 - 275,000
Equity
AI Evaluation Engineer – Reinforcement Learning & Agents
AI Evaluation Engineer – Reinforcement Learning & Agents

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 210,000
RL Environments Engineer
RL Environments Engineer

Bespoke-Labs • Mountain View (CA)

On-site
USD 250,000 - 300,000
Health, dental, and vision
401(k)
Daily onsite lunch
+3