Senior ML Infrastructure Engineer - Scale AI Systems

Goliath Partners Inc.; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Goliath Partners Inc. is seeking exceptional ML Infrastructure Engineers to join innovative AI teams. You will design and operate scalable, production-grade ML infrastructure supporting large-scale model training and efficient inference.

Ideal candidates have 5+ years in ML infra or distributed systems, strong Python/C++/Go, and hands-on experience with PyTorch/JAX, Kubernetes, Docker, and cloud GPU environments. PhD is a plus, with proven impact in high-growth AI settings.

Qualifications

• 5+ years of experience in ML Infrastructure, Distributed Systems, or Software Engineering, or equivalent demonstrated expertise.
• Strong programming skills in Python and C++ or Go.
• Hands-on experience with PyTorch, JAX, or similar ML frameworks.
• Experience building scalable distributed training and inference infrastructure.
• Strong knowledge of Kubernetes, Docker, AWS/GCP, and GPU compute environments.
• Experience optimizing system performance, reliability, latency, and throughput.
• Proven ability to design and own production ML infrastructure at scale.

Skills

Python

C++/Go

PyTorch

JAX

Kubernetes

Docker

AWS/GCP

GPU compute

Distributed training

Performance optimization

Education

Bachelor's or Master's in CS/CE/Math

PhD in CS/ML/DS (plus)

Exceptional engineers with impact

Tools

CUDA

Triton

NCCL

Ray/DeepSpeed/Megatron-LM

Job description

Goliath Partners Inc. is seeking exceptional ML Infrastructure Engineers to join innovative AI teams. You will design and operate scalable, production-grade ML infrastructure supporting large-scale model training and efficient inference.

Ideal candidates have 5+ years in ML infra or distributed systems, strong Python/C++/Go, and hands-on experience with PyTorch/JAX, Kubernetes, Docker, and cloud GPU environments. PhD is a plus, with proven impact in high-growth AI settings.