Staff Engineer, Traffic Infrastructure & Cloud Networking

Fireworks; San Mateo (CA); On-site; USD 260,000 - 360,000; Full time

Job summary

Fireworks is seeking a Member of Technical Staff to own the traffic layer behind our generative AI platform, including proxies, load balancers, service mesh, and routing across regions and clouds.

You will collaborate with ML, product, and platform teams, mentor engineers, and drive scalable infrastructure with a focus on availability and cost efficiency. This role requires deep distributed systems expertise in high-throughput environments.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field (or equivalent practical experience).
• 5+ years building backend or network infrastructure in cloud environments (e.g., AWS, GCP, Azure).
• Strong software development skills in Go, C++, Rust, Java, or Python.
• Deep understanding of distributed systems and networking fundamentals, including performance optimization.
• Full product lifecycle ownership, from design through implementation to production.

Responsibilities

• Architect and build scalable, fault-tolerant traffic and networking services, including ingress/egress, load balancing, routing, and QoS controls.
• Lead technical design discussions, mentor other engineers, and establish best practices for operating large-scale infrastructure.
• Drive network optimization both inside and outside data centers, including cost reduction and performance tuning.
• Evaluate and integrate cloud-native/open-source technologies (Kubernetes, Envoy, Istio) to strengthen platform capabilities.
• Own systems end to end, from design through deployment and observability, emphasizing high availability and disaster recovery.
• Develop and maintain comprehensive monitoring, alerting, logging, and tracing for deep system health insights.

Skills

Distributed systems

Cloud networking

Go

C++

Python

Load balancing

Mentoring

Education

Bachelor's degree in CS/Engineering or related

Master's or PhD in CS (preferred)

Tools

Kubernetes

Envoy

Istio

Cloud platforms (AWS/GCP/Azure)

Job description

Fireworks is seeking a Member of Technical Staff to own the traffic layer behind our generative AI platform, including proxies, load balancers, service mesh, and routing across regions and clouds.

You will collaborate with ML, product, and platform teams, mentor engineers, and drive scalable infrastructure with a focus on availability and cost efficiency. This role requires deep distributed systems expertise in high-throughput environments.