Senior ML Infra Engineer - Real-Time AI Backends

Acceler8 Talent; San Francisco (CA); Hybrid; USD 247,500 - 302,500; Full time

Job summary

A forward-thinking AI company is seeking a Senior ML Infrastructure / Backend Engineer to develop backend systems supporting real-time AI functionality. You will manage APIs, scale cloud infrastructure, and ensure system reliability while collaborating with various teams. The ideal candidate should possess strong backend development skills and experience with cloud platforms, shaping the future of AI-powered digital interactions. The salary is competitive, reaching up to $275k depending on qualifications, with a hybrid work model in Los Angeles or San Francisco.

Qualifications

• Strong experience building and owning backend or distributed systems.
• Hands-on experience designing APIs, preferably using Python.
• Experience running ML-backed systems in production environments.

Responsibilities

• Own backend services and APIs that expose ML-powered features.
• Design and operate orchestration layers for ML workloads.
• Scale infrastructure to support high user traffic.

Skills

Backend services development

API design and operation (Python preferred)

Cloud platforms (AWS, GCP)

Performance tuning

Debugging and operational ownership

Tools

FastAPI

Flask

gRPC

Ray Serve

Triton

Job description

A forward-thinking AI company is seeking a Senior ML Infrastructure / Backend Engineer to develop backend systems supporting real-time AI functionality. You will manage APIs, scale cloud infrastructure, and ensure system reliability while collaborating with various teams. The ideal candidate should possess strong backend development skills and experience with cloud platforms, shaping the future of AI-powered digital interactions. The salary is competitive, reaching up to $275k depending on qualifications, with a hybrid work model in Los Angeles or San Francisco.