Senior ML Platform Engineer: RL Environments & Automation (Equity)

Preference Model, Inc.; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Competitive compensation

Equity

Health benefits

401K match

Lunch provided onsite

Weekly snacks

Visa sponsorship & relocation support

Job summary

Preference Model, Inc. is hiring a senior ML Platform engineer in San Francisco to own the systems turning a builder’s repo into a lab training run. You’ll manage Karotte, the open-source RL environment framework, plus the internal platform that builds, runs, and grades environments on CPU, GPU, and TPU.

You will lead automation, scale infrastructure, and deliver reliable, sandboxed environments for frontier labs, with visa sponsorship and relocation support available.

Qualifications

• 5+ years building and owning ML platform engineering.
• Strong fundamentals in software engineering for production infra.
• Hands-on with containers and orchestration and at least one major cloud platform.

Responsibilities

• Own integrations delivering environments to partner labs; build images and automate checks.
• Build and maintain Karotte open-source framework from API design through releases.
• Run and scale infrastructure for environments across CPU, GPU, and TPU.
• Develop internal tools used by environment builders (CLI, docs, data catalog, access controls).
• Collaborate with builders/researchers to turn pain points into platform features.

Skills

Python

Containers

Tools

Docker

Kubernetes

GCP

Job description

Preference Model, Inc. is hiring a senior ML Platform engineer in San Francisco to own the systems turning a builder’s repo into a lab training run. You’ll manage Karotte, the open-source RL environment framework, plus the internal platform that builds, runs, and grades environments on CPU, GPU, and TPU.

You will lead automation, scale infrastructure, and deliver reliable, sandboxed environments for frontier labs, with visa sponsorship and relocation support available.