ML Infrastructure Engineer: Scale Large-Scale Training

Goliath Partners Inc.; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Goliath Partners Inc. is seeking an ML Infrastructure Engineer in the San Francisco Bay Area to build and scale the infrastructure for training large ML models. You will develop distributed training systems, pipelines, and tooling to accelerate research and production deployments.

You will own GPU load balancing, checkpointing, and experiment management while improving throughput and reliability in a fast-moving environment with strong technical ownership. Bay Area in-person work is expected.

Qualifications

• Strong Python and software engineering fundamentals.
• Experience building ML infrastructure, training infrastructure, or large-scale distributed systems.
• Experience working with PyTorch and modern ML training stacks.
• Strong understanding of distributed computing and GPU-based workloads.
• Experience building reliable systems that support ML research or production ML.
• Comfortable working in a fast-moving environment with significant technical ownership.

Responsibilities

• Build and scale infrastructure for training large machine learning models.
• Develop distributed training systems and improve training efficiency, reliability, and throughput.
• Build data pipelines and infrastructure supporting large-scale ML workloads.
• Improve GPU utilization, compute orchestration, checkpointing, and experiment management.
• Develop tooling that enables researchers and ML engineers to iterate faster.
• Diagnose performance bottlenecks across training, data, and compute systems.
• Help take ML systems from experimentation through production and real-world deployment.

Skills

Python

Distributed computing

ML training stacks

GPU workloads

Production ML

Research support

Tools

PyTorch

Job description

Goliath Partners Inc. is seeking an ML Infrastructure Engineer in the San Francisco Bay Area to build and scale the infrastructure for training large ML models. You will develop distributed training systems, pipelines, and tooling to accelerate research and production deployments.

You will own GPU load balancing, checkpointing, and experiment management while improving throughput and reliability in a fast-moving environment with strong technical ownership. Bay Area in-person work is expected.