Cloud-Native Training Infrastructure Engineer

Fireworks AI; New York (NY); On-site; USD 170,000 - 260,000; Full time

Job summary

Fireworks AI in New York seeks a Training Infrastructure Engineer to design and maintain large-scale backend and cloud-native systems for distributed ML training and inference. You will architect scalable services, lead design discussions, and mentor engineers to improve reliability and performance across the platform.

You will collaborate with ML, DevOps, and product teams, evaluate Kubernetes, Ray, Kubeflow, and MLFlow, and own end-to-end systems from design to deployment with emphasis on

Qualifications

• Bachelor's degree in CS or related field; four+ years of backend infra experience.
• Experience building large-scale distributed data systems in cloud environments.
• Proficient in Python, C++, Go, or TS; strong design documentation skills.

Responsibilities

• Architect scalable backend services for training/inference platforms.
• Lead design discussions and mentor engineers across teams.
• Improve compute cost, storage, and network performance.
• Collaborate with ML, DevOps, and product to translate requirements.
• Evaluate cloud-native tools: Kubernetes, Ray, Kubeflow, MLFlow.

Skills

Backend design

Cloud services

Python

Go

TypeScript

C++

Leadership

Data pipelines

Education

Bachelor's degree in CS or related

Tools

Docker

Kubernetes

Ray

Kubeflow

MLFlow

PostgreSQL

Kafka

Job description

Fireworks AI in New York seeks a Training Infrastructure Engineer to design and maintain large-scale backend and cloud-native systems for distributed ML training and inference. You will architect scalable services, lead design discussions, and mentor engineers to improve reliability and performance across the platform.

You will collaborate with ML, DevOps, and product teams, evaluate Kubernetes, Ray, Kubeflow, and MLFlow, and own end-to-end systems from design to deployment with emphasis on