Senior ML Infra Engineer - Large-Scale Training & Pipelines

Kindredventures; San Francisco (CA); On-site; USD 160,000 - 220,000; Full time

Job description

Responsibilities

• Design, deploy, and maintain large distributed ML training and inference clusters
• Develop efficient, scalable end-to-end pipelines to manage petabyte-scale datasets and model training throughout the entire ML lifecycle
• Research and test various training approaches including parallelization techniques and numerical precision trade-offs across different model scales
• Analyze, profile and debug low-level GPU operations to optimize performance
• Stay up-to-date on research to bring new ideas to work

What we’re looking for

We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.

• Strong grasp of state-of-the‑art techniques for optimizing training and inference workloads
• Demonstrated proficiency with distributed training frameworks (e.g. FSDP, DeepSpeed) to train large foundation models
• Knowledge of cloud platforms (GCP, AWS, or Azure) and their ML/AI service offerings
• Familiarity with containerization and orchestration frameworks (e.g., Kubernetes, Docker)
• Background working on distributed task management systems and scalable model serving & deployment architectures
• Understanding of monitoring, logging, observability, and version control best practices for ML systems

You don’t have to meet every single requirement above.