Infra Software Engineer — Large-Scale Distributed Systems

AI Chopping Block, Inc.; San Francisco (CA); On-site; USD 300,000 - 400,000; Full time

Benefits offered by this job

Health insurance

Dental and vision benefits

Unlimited PTO

Paid parental leave

Relocation support

Job summary

Thinking Machines in San Francisco is seeking a Software Engineer, Infrastructure to design and build the distributed systems powering our model training and serving platforms. You will own critical systems from clusters that train frontier models to multi-tenant serving infrastructure behind Tinker, with real ownership in a fast-moving startup.

You will collaborate with researchers and platform engineers, implement robust, well-abstracted Python and Go components, and improve reliability,

Qualifications

• Demonstrated expertise designing and developing large-scale distributed systems
• Strong proficiency in Python and Go
• Experience building, deploying, and operating production infrastructure at scale
• Solid grounding in distributed systems fundamentals, such as consensus, consistency, fault tolerance, and networking

Responsibilities

• Design, build, and operate distributed systems that support large-scale model training and inference across thousands of accelerators
• Build and maintain core infrastructure, including orchestration, scheduling, storage, and resource management systems
• Improve the reliability, performance, and observability of infrastructure used across research and product teams
• Partner with researchers and platform engineers to understand infrastructure needs and turn them into robust, well-abstracted systems
• Debug and resolve complex distributed failures across the stack, from networking and storage to compute and scheduling
• Write and maintain internal libraries and APIs, primarily in Python and Go, that other engineers build on

Skills

Distributed systems design

Python

Go

Production infrastructure

Distributed systems fundamentals

Tools

Kubernetes

Terraform

Docker

Open-source contributions

Job description

Thinking Machines in San Francisco is seeking a Software Engineer, Infrastructure to design and build the distributed systems powering our model training and serving platforms. You will own critical systems from clusters that train frontier models to multi-tenant serving infrastructure behind Tinker, with real ownership in a fast-moving startup.

You will collaborate with researchers and platform engineers, implement robust, well-abstracted Python and Go components, and improve reliability,