Staff Engineer: Heterogeneous Runtime & Placement

General Diffusion, Inc.

San Francisco, Northern (CA, KY)

Hybrid

USD 170,000 - 250,000

Full time

10 days ago
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

General Diffusion, Inc. seeks a Member of Technical Staff to own the execution contract for cross-target workloads. You will ensure visible, reversible runtime actions and rejects infeasible targets before ranking candidates.

Collaboration with compiler, GPU systems, and safety teams shapes capability and guardrail signals. You will design guarded rollout, canary, and rollback mechanisms, and document end-to-end traces from request through placement to outcome, enabling auditability and safe

Qualifications

  • Experience shipping or operating a scheduler, inference-serving system, or distributed runtime.
  • Judgment on heterogeneous workload lifecycles: compatibility, admission, failure and recovery.
  • Ability to formalize constraints into explicit contracts and observable state transitions.

Responsibilities

  • Define the execution contract mapping workload requirements to target capabilities and runtime checks.
  • Build runtime and control-plane paths linking workloads to targets with safe fallback.
  • Ensure decisions are inspectable by capturing eligibility, target, context, actions, and outcomes.
  • Develop conformance tests and canary/recovery drills for partial failures feature guards.

Skills

Scheduler experience
Distributed systems
Telemetry & debugging
Guarried rollout design

Tools

Tracing systems
Canary tooling
Observability platforms

Job description

General Diffusion, Inc. seeks a Member of Technical Staff to own the execution contract for cross-target workloads. You will ensure visible, reversible runtime actions and rejects infeasible targets before ranking candidates.

Collaboration with compiler, GPU systems, and safety teams shapes capability and guardrail signals. You will design guarded rollout, canary, and rollback mechanisms, and document end-to-end traces from request through placement to outcome, enabling auditability and safe

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Heterogeneous Runtime & Placement
Member of Technical Staff, Heterogeneous Runtime & Placement

General Diffusion, Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 170,000 - 250,000
ML Compiler & Codegen Engineer for Heterogeneous Backends
ML Compiler & Codegen Engineer for Heterogeneous Backends

General Diffusion, Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 260,000
Staff Engineer, GPU Systems & Fabric
Staff Engineer, GPU Systems & Fabric

General Diffusion, Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 250,000
Staff Engineer, Distributed Systems & Fleet Reliability
Staff Engineer, Distributed Systems & Fleet Reliability

General Diffusion, Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 160,000 - 220,000
Member of Technical Staff, ML Compilers & Code Generation
Member of Technical Staff, ML Compilers & Code Generation

General Diffusion, Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 260,000
Kernel Performance Engineer (CUDA/Triton)
Kernel Performance Engineer (CUDA/Triton)

General Diffusion, Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 280,000
Member of Technical Staff, Safety & Formal Verification
Member of Technical Staff, Safety & Formal Verification

General Diffusion, Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 260,000
Independent Safety & Formal Verification Engineer
Independent Safety & Formal Verification Engineer

General Diffusion, Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 260,000
RL & Compute Environments Research Engineer
RL & Compute Environments Research Engineer

General Diffusion, Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 280,000
Staff Scientist, Action-Conditioned Compute World Models
Staff Scientist, Action-Conditioned Compute World Models

General Diffusion, Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000