RL & Compute Environments Research Engineer

General Diffusion, Inc.; San Francisco, Northern (CA, KY); Hybrid; USD 180,000 - 280,000; Full time

Job summary

General Diffusion, Inc. in San Francisco seeks a Member of Technical Staff to turn compute predictions into constrained, measurable decisions.

You will define environment abstractions, evaluation contracts, and baselines to guide placement and resource allocation without owning production paths. You will build offline evaluation pipelines, report calibration limits and failure cases, and collaborate with ML researchers, runtime engineers, data teams, and safety reviewers to ensure rigorous,

Qualifications

• Experience with RL, contextual bandits, planning, or off-policy evaluation where state distributions change and decisions have delayed system effects.
• Ability to turn a systems problem into a falsifiable experimental environment, including action semantics, reward trade-offs, baselines, held-out conditions, and variance-aware measurement.
• Strong programming and experimental-systems practice: build reliable research pipelines, inspect failures, and make experiments repeatable.
• Practical scheduling or resource-allocation intuition, including trade-offs among latency, throughput, utilization, contention, and feasibility across heterogeneous resources.
• Sound judgment about safe empirical work: distinguish simulation or offline evidence from online evidence, set bounded experiment conditions, and state uncertainty plainly.

Responsibilities

• Design representative compute-environment abstractions: state, feasible placement actions, transition assumptions, rewards, and explicit constraint signals for heterogeneous workloads.
• Build reproducible offline evaluation and counterfactual-analysis workflows that compare candidate policies against baselines using held-out workload, architecture, and drift conditions.
• Develop policy-learning and planning experiments that use action-conditioned performance predictions while reporting calibration limits and uncertainty-sensitive failure cases.
• Define shadow-evaluation and narrowly scoped online-experiment protocols with predeclared metrics, stop conditions, and rollback criteria; partner with Runtime on execution but do not own the production placement path.
• Measure how policy quality changes with workload mix, hardware capability differences, delayed effects, and distribution shift, separating reward improvement from operational reliability.
• Communicate decision evidence and known limitations to World Models, Runtime, and Safety & Verification; independent controls—not this role’s reward or policy—determine whether an action is permitted.

Skills

Reinforcement learning

Contextual bandits

Planning

Off-policy evaluation

Experiment design

Job description

General Diffusion, Inc. in San Francisco seeks a Member of Technical Staff to turn compute predictions into constrained, measurable decisions.

You will define environment abstractions, evaluation contracts, and baselines to guide placement and resource allocation without owning production paths. You will build offline evaluation pipelines, report calibration limits and failure cases, and collaborate with ML researchers, runtime engineers, data teams, and safety reviewers to ensure rigorous,