Staff Software Engineer, Inference Deployment & Automation

Deepstreamtech; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Deepstreamtech is seeking a Software Engineer for the Launch Engineering team in San Francisco, CA. The role focuses on designing and building deployment infrastructure for inference models, optimizing scheduling against constrained resources like GPUs and TPUs. Ideal candidates should have extensive experience in creating deployment systems at scale, strong software engineering skills, and proficiency in Kubernetes deployments. Deepstreamtech is committed to making inference deployment seamless and unattended while ensuring high performance and reliability.

Qualifications

• 5+ years of experience building deployment infrastructure at scale.
• Experience designing systems managing complex state machines and multi-stage pipelines.
• Strong communication and ability to work closely with various teams.

Responsibilities

• Design and build deployment infrastructure for inference code.
• Optimize deployment scheduling to manage constrained resources.
• Ensure continuous and unattended deployment across fleets.

Skills

Experience building deployment infrastructure

Strong software engineering skills

Proficiency with Kubernetes-based deployments

Communication skills

Experience with resource-constrained scheduling

Experience in Python or Rust

Job description

Deepstreamtech is seeking a Software Engineer for the Launch Engineering team in San Francisco, CA. The role focuses on designing and building deployment infrastructure for inference models, optimizing scheduling against constrained resources like GPUs and TPUs. Ideal candidates should have extensive experience in creating deployment systems at scale, strong software engineering skills, and proficiency in Kubernetes deployments. Deepstreamtech is committed to making inference deployment seamless and unattended while ensuring high performance and reliability.