AI Training Infrastructure Engineer — Distributed Systems

Fireworks AI; New York (NY); On-site; USD 140,000 - 220,000; Full time

Job summary

Fireworks AI in New York is seeking a Training Infrastructure Engineer to design, build, and optimize the infrastructure powering large-scale model training. You will collaborate with AI researchers and engineers to create robust training pipelines and ensure reliable model development.

You'll work on distributed training, multi-GPU deployments, and data-center optimizations, shaping scalable infrastructure for cutting-edge AI workloads at Fireworks AI.

Qualifications

• Bachelor's degree in CS/CE or related field or equivalent practical experience.
• 3+ years of experience with distributed systems and ML infrastructure.
• Experience with PyTorch.
• Proficiency in cloud platforms (AWS, GCP, Azure).
• Experience with containerization and orchestration (Kubernetes, Docker).
• Knowledge of distributed training techniques (data parallelism, model parallelism, FSDP).

Responsibilities

• Design and implement scalable infrastructure for large-scale model training workloads
• Develop and maintain distributed training pipelines for LLMs and multimodal models
• Optimize training performance across GPUs, nodes, and data centers
• Implement monitoring, logging, and debugging tools for training operations
• Architect and maintain data storage solutions for large-scale training datasets
• Automate infrastructure provisioning, scaling, and orchestration for model training
• Collaborate with researchers to implement and optimize training methodologies
• Analyze and improve efficiency, scalability, and cost-effectiveness of training systems
• Troubleshoot complex performance issues in distributed training environments

Skills

Distributed systems

ML infrastructure

PyTorch

Education

Bachelor's degree in CS/CE or related field

Master's or PhD in CS or related field

Tools

Docker

Kubernetes

Job description

Fireworks AI in New York is seeking a Training Infrastructure Engineer to design, build, and optimize the infrastructure powering large-scale model training. You will collaborate with AI researchers and engineers to create robust training pipelines and ensure reliable model development.

You'll work on distributed training, multi-GPU deployments, and data-center optimizations, shaping scalable infrastructure for cutting-edge AI workloads at Fireworks AI.