Distributed AI Training Infrastructure Engineer

FDE Times; San Mateo; Vor Ort; PHP 1.200.000 - 1.800.000; Vollzeit

Zusammenfassung

Fireworks AI is seeking a Training Infrastructure Engineer to design and optimize the infrastructure powering our large-scale model training operations. You will work with researchers to build robust training pipelines, scale distributed workloads, and ensure reliable model development.

You will collaborate across GPUs, data centers, and cloud platforms, implementing monitoring and automation to improve performance, efficiency, and cost effectiveness of our training systems.

Qualifikationen

• Bachelor's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience.
• 3+ years of experience with distributed systems and ML infrastructure.
• Experience with PyTorch.
• Proficiency in cloud platforms (AWS, GCP, Azure).
• Experience with containerization, orchestration (Kubernetes, Docker).
• Knowledge of distributed training techniques (data parallelism, model parallelism, FSDP).

Aufgaben

• Design and implement scalable infrastructure for large‑scale model training workloads.
• Develop and maintain distributed training pipelines for LLMs and multimodal models.
• Optimize training performance across multiple GPUs, nodes, and data centers.
• Implement monitoring, logging, and debugging tools for training operations.
• Architect and maintain data storage solutions for large‑scale training datasets.
• Automate infrastructure provisioning, scaling, and orchestration for model training.
• Collaborate with researchers to implement and optimize training methodologies.
• Analyze and improve efficiency, scalability, and cost‑effectiveness of training systems.
• Troubleshoot complex performance issues in distributed training environments.

Kenntnisse

Distributed systems

ML infrastructure

PyTorch

Cloud platforms (AWS/GCP/Azure)

Containerization & orchestration

Ausbildung

Bachelor's degree in CS/CE or related field

Tools

Kubernetes

Docker

AWS

GCP

Azure

Jobbeschreibung

Fireworks AI is seeking a Training Infrastructure Engineer to design and optimize the infrastructure powering our large-scale model training operations. You will work with researchers to build robust training pipelines, scale distributed workloads, and ensure reliable model development.

You will collaborate across GPUs, data centers, and cloud platforms, implementing monitoring and automation to improve performance, efficiency, and cost effectiveness of our training systems.