Backend Platform Engineer – AI Gateway (Golang)

People Culture Talent; San Francisco (CA); On-site; USD 200,000 - 350,000; Full time

Benefits offered by this job

Comprehensive health, dental, vision

Visa sponsorship available

Equity opportunity

Job summary

Our client in San Francisco is seeking a Software Engineer, Platform to shape the future of AI model evaluation and delivery. You will join as a founding member of the developer team, working with founders and early customers to define and build scalable platform capabilities.

The role focuses on building a robust backend platform, streaming API handling, and observability, with onsite presence in San Francisco three days per week and strong collaboration across teams.

Qualifications

• 5+ years of professional software engineering experience, focused on backend services or distributed systems.
• Strong Golang experience and production-grade backend systems.
• Experience designing reliable APIs, service integrations, or gateway-style systems.

Responsibilities

• Build and scale backend platform services for the AI gateway.
• Handle SSE/streaming responses across providers and ensure fault tolerance.
• Implement authentication, rate limiting, usage metering, and cost tracking.
• Build observability with distributed tracing and real-time dashboards.
• Collaborate with research and product teams to turn ideas into features.
• Work across platform and product boundaries on Leaderboards and Evals.

Skills

Backend engineering

Golang

API design

Distributed systems

Platform experience

Tools

Kubernetes

Cloud (GCP/AWS/Azure)

Job description

Our client in San Francisco is seeking a Software Engineer, Platform to shape the future of AI model evaluation and delivery. You will join as a founding member of the developer team, working with founders and early customers to define and build scalable platform capabilities.

The role focuses on building a robust backend platform, streaming API handling, and observability, with onsite presence in San Francisco three days per week and strong collaboration across teams.