Platform Engineer - AI Infrastructure & Gateways

Arena Intelligence, Inc.; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Competitive compensation & equity

Health & wellness benefits

Cutting-edge AI projects

Transparent culture

Job summary

Arena Intelligence is hiring a Software Engineer - Platform to build the core infrastructure for online evaluation systems at scale in San Francisco. You’ll influence gateways, runtimes, and serving layers, collaborating with researchers and product leadership on zero-to-one and scale-it-up work.

You will bring 5+ years of backend experience, strong Go, and familiarity with LLM APIs, cloud infra, and developer-facing APIs.

Qualifications

• 5+ years of backend engineering experience.
• Experience with distributed systems and developer-facing platforms.
• Proficiency in Go as the primary backend language.
• Experience with LLM provider APIs and scaling challenges.
• Product-minded with focus on developer experience of APIs.
• Comfort with ambiguity in a startup environment.

Responsibilities

• Build API-based products from the ground up for leaderboards, models, and arenas.
• Solve streaming problems with SSE and partial failure recovery.
• Ship enterprise-grade infrastructure: rate limiting, auth, usage metering, audits, SOC 2.
• Build observability with tracing, latency breakdowns, and dashboards.
• Collaborate with researchers to turn ideas into products; no data labeling.
• Contribute to backend of Leaderboards and Evals when needed.

Skills

Backend engineering

Distributed systems

Go

LLM APIs

Product mindset

Ambiguity tolerance

Tools

AWS / GCP / Azure

Kubernetes

Terraform

PostgreSQL

Redis

Job description

Arena Intelligence is hiring a Software Engineer - Platform to build the core infrastructure for online evaluation systems at scale in San Francisco. You’ll influence gateways, runtimes, and serving layers, collaborating with researchers and product leadership on zero-to-one and scale-it-up work.

You will bring 5+ years of backend experience, strong Go, and familiarity with LLM APIs, cloud infra, and developer-facing APIs.