Distributed AI Training Infrastructure Engineer

Fireworks AI; United States; Remote; USD 130,000 - 210,000; Full time

Job summary

Fireworks AI in the United States is seeking a Training Infrastructure Engineer to design, build, and optimize infrastructure for large-scale model training. You will collaborate with AI researchers and engineers to create robust training pipelines, optimize distributed workloads, and ensure reliable model development.

Join a team scaling GPU clusters across data centers, implementing monitoring, logging, and automation, and advancing cost-efficient, high-performance training for multimodal and

Qualifications

• Bachelor's degree in CS, CE, or related field, or equivalent practical experience.
• 3+ years of experience with distributed systems and ML infrastructure.
• Experience with PyTorch.
• Proficiency in cloud platforms (AWS, GCP, Azure).
• Experience with containerization, orchestration (Kubernetes, Docker).
• Knowledge of distributed training techniques (data parallelism, model parallelism, FSDP).

Responsibilities

• Design and implement scalable infrastructure for large-scale model training workloads.
• Develop and maintain distributed training pipelines for LLMs and multimodal models.
• Optimize training performance across multiple GPUs, nodes, and data centers.
• Implement monitoring, logging, and debugging tools for training operations.
• Architect and maintain data storage solutions for large-scale training datasets.
• Automate infrastructure provisioning, scaling, and orchestration for model training.
• Collaborate with researchers to implement and optimize training methodologies.
• Analyze and improve efficiency, scalability, and cost-effectiveness of training systems.
• Troubleshoot complex performance issues in distributed training environments.

Skills

Distributed systems

ML infrastructure

PyTorch

AWS

GCP

Azure

Kubernetes

Docker

Data parallelism

Model parallelism

Education

Bachelor's degree in Computer Science, Computer Engineering, or related field

Tools

Kubernetes

Docker

Job description

Fireworks AI in the United States is seeking a Training Infrastructure Engineer to design, build, and optimize infrastructure for large-scale model training. You will collaborate with AI researchers and engineers to create robust training pipelines, optimize distributed workloads, and ensure reliable model development.

Join a team scaling GPU clusters across data centers, implementing monitoring, logging, and automation, and advancing cost-efficient, high-performance training for multimodal and