Senior ML Infrastructure Engineer: Scalable AI Systems

Goliath Partners Inc.; San Francisco (CA); Sur place; USD 150 000 - 230 000; Plein temps

Résumé du poste

Goliath Partners Inc. in San Francisco seeks an experienced ML Infrastructure Engineer to help scale the infrastructure behind cutting-edge AI systems. You will own the design and delivery of training and inference pipelines that power large models.

Key tasks include building distributed systems, optimizing GPU workloads, and ensuring reliability across cloud environments using Kubernetes and Docker with AWS/GCP.

Qualifications

• 5+ years in ML Infra, distributed systems, or equivalent.
• Strong programming in Python and C++ or Go.
• Hands-on with PyTorch or JAX.
• Experience building scalable training and inference infra.
• Know-how of Kubernetes, Docker, AWS/GCP and GPU environments.
• Proven ability to design production ML infrastructure at scale.

Responsabilités

• Design, build and own production ML infrastructure at scale.
• Develop scalable distributed training and inference systems.
• Optimize system performance, latency and throughput.
• Collaborate with research and platform teams to deploy models.

Connaissances

ML infrastructure

Distributed systems

Software engineering

Python

C++

Go

PyTorch

JAX

Kubernetes

Docker

AWS

GCP

GPU compute

Performance optimization

Production ML at scale

Formation

Bachelor's or Master's in CS/CE/Math

PhD in CS/ML/DS is a plus

Outils

CUDA

Triton

NCCL

Ray

DeepSpeed

Megatron-LM

Description du poste

Goliath Partners Inc. in San Francisco seeks an experienced ML Infrastructure Engineer to help scale the infrastructure behind cutting-edge AI systems. You will own the design and delivery of training and inference pipelines that power large models.

Key tasks include building distributed systems, optimizing GPU workloads, and ensuring reliability across cloud environments using Kubernetes and Docker with AWS/GCP.