Senior ML Inference Deployment Engineer

United States Digital Space LLC; San Francisco (CA); On-site; USD 320,000 - 485,000; Full time

Benefits offered by this job

Visa sponsorship

Hybrid work policy where staff are in the office at least 25% of the time

Job summary

United States Digital Space LLC in San Francisco is seeking a Software Engineer for the Launch Engineering team. This role focuses on designing and building deployment infrastructure for inference code across various accelerator fleets, ensuring efficient production processes.

The ideal candidate will possess strong software engineering skills, experience with Kubernetes, and a thorough understanding of deployment infrastructure under resource constraints. The position offers a competitive salary range, emphasizing career growth in a collaborative environment.

Qualifications

• Strong software engineering skills, including experience designing complex state machines.
• Experience building deployment infrastructure affected by resource constraints.
• Proficiency with rolling update mechanics and container orchestration.

Responsibilities

• Own deployment orchestration to move validated inference builds into production.
• Improve deployment scheduling maximizing throughput under resource constraints.
• Extend deployment observability with dashboards and tooling.

Skills

Software engineering skills

Kubernetes-based deployments

Deployment infrastructure development

Automation building

Backend services and databases

Strong communication skills

Education

Bachelor’s degree or equivalent

Tools

Kubernetes

Python

Rust

Job description

United States Digital Space LLC in San Francisco is seeking a Software Engineer for the Launch Engineering team. This role focuses on designing and building deployment infrastructure for inference code across various accelerator fleets, ensuring efficient production processes.

The ideal candidate will possess strong software engineering skills, experience with Kubernetes, and a thorough understanding of deployment infrastructure under resource constraints. The position offers a competitive salary range, emphasizing career growth in a collaborative environment.