AI Infrastructure Engineer

Fireworks; San Mateo; On-site; PHP 1,800,000 - 3,000,000; Full time

Job summary

Fireworks AI is seeking a Software Engineer on our AI Infrastructure team to design the core systems powering our generative AI platform. You will help build infrastructure and tools that ensure the reliability, performance, quality, and availability of our AI system.

You''ll partner with the cloud infrastructure, product, and performance teams to deliver scalable infrastructure that bridges the gap between customers and our ultra-performant Fireworks inference engine.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).
• 3 years of experience in software engineering, with a focus on infrastructure or ML systems.
• Strong programming skills in Python, Go, or a similar language.
• Proven experience in ML infrastructure and tooling (e.g., PyTorch, MLflow, Vertex AI, SageMaker, Kubernetes, etc.).
• Basic understanding of LLM knowledge (e.g., context length, disaggregated prefill, KV cache memory estimation, etc)

Responsibilities

• Contribute to the design and development of scalable backend infrastructure that supports distributed training, inference, and data pipelines
• Build and maintain core backend services such as LLM CI/CD pipeline, control plane, and model serving systems
• Support performance optimization, cost efficiency, and reliability improvements across compute, storage, and networking layers
• Building frameworks and safeguards to ensure Fireworks AI has the best model quality in the industry
• Collaborate with performance, training, and product teams to translate research and product needs into infrastructure solutions
• Participate in code reviews, technical discussions, and continuous integration and deployment processes

Skills

Python

Go

ML infrastructure

Kubernetes

PyTorch

LLM knowledge

Open-source ML engines

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

MLflow

Vertex AI

SageMaker

Job description

Fireworks AI is seeking a Software Engineer on our AI Infrastructure team to design the core systems powering our generative AI platform. You will help build infrastructure and tools that ensure the reliability, performance, quality, and availability of our AI system.

You''ll partner with the cloud infrastructure, product, and performance teams to deliver scalable infrastructure that bridges the gap between customers and our ultra-performant Fireworks inference engine.