Staff Engineer, Enterprise AI Infrastructure

Fireworks AI; New York (NY); On-site; USD 180,000 - 260,000; Full time

Job summary

Fireworks AI is seeking a seasoned backend engineer to own end-to-end capabilities from data models to control plane and console. You will migrate live systems, define enterprise-ready primitives, and connect with federation and provisioning, enabling secure, scalable implementation for large customers.

You will design multi-tenant authorization, metering, and encryption strategies, work across AWS, GCP, and Azure, and partner with customers to ship production-grade features that drive revenue

Qualifications

• 4+ years building and operating production backend or distributed systems at scale.
• Strong server-side engineering skills in Go, Python, C++, TypeScript, or similar.
• Experience designing APIs and data models under live traffic without breaking callers.
• Hands-on depth in at least one major cloud (AWS, GCP, or Azure): IAM and workload identity, KMS, object storage, and VPC networking.
• Track record of owning an ambiguous, cross-team workstream from requirement through production.
• Willingness to work directly with customers.

Responsibilities

• Own foundational capabilities end to end - data model and API through control plane, runtime, SDK/CLI, and console - and migrate live systems onto them.
• Design the primitives large customers organize around - organizations and sub-accounts, groups, roles, service identities - and connect them to enterprise directories through federation and provisioning (SSO, SCIM).
• Design multi-tenant authorization, policy enforcement, and audit systems that hold up in front of a security architect.
• Make usage metering, spend controls, and billing correct and legible at scale - customers reconcile our numbers against their own.
• Own data isolation and key management - customer-managed encryption keys across AWS, GCP, and Azure - threaded through datasets, fine-tuning, RL, checkpoints, models, and inference.
• Deploy and operate Fireworks inside a customer's own cloud, and solve data residency and regional isolation for customers with hard constraints.
• Use AI tooling aggressively - we expect you to automate yourself.

Skills

Backend systems

API design

Cross-team ownership

Customer engagement

Cloud exposure

Education

Bachelor's degree in CS or equivalent

Tools

Go

Python

TypeScript

C++

Terraform

Kubernetes

Job description

Fireworks AI is seeking a seasoned backend engineer to own end-to-end capabilities from data models to control plane and console. You will migrate live systems, define enterprise-ready primitives, and connect with federation and provisioning, enabling secure, scalable implementation for large customers.

You will design multi-tenant authorization, metering, and encryption strategies, work across AWS, GCP, and Azure, and partner with customers to ship production-grade features that drive revenue