Platform Engineer - AI Infrastructure & Gateways

Arena Intelligence, Inc.

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation & equity
Health & wellness benefits
Cutting-edge AI projects
Transparent culture

Job summary

Arena Intelligence is hiring a Software Engineer - Platform to build the core infrastructure for online evaluation systems at scale in San Francisco. You’ll influence gateways, runtimes, and serving layers, collaborating with researchers and product leadership on zero-to-one and scale-it-up work.

You will bring 5+ years of backend experience, strong Go, and familiarity with LLM APIs, cloud infra, and developer-facing APIs.

Qualifications

  • 5+ years of backend engineering experience.
  • Experience with distributed systems and developer-facing platforms.
  • Proficiency in Go as the primary backend language.
  • Experience with LLM provider APIs and scaling challenges.
  • Product-minded with focus on developer experience of APIs.
  • Comfort with ambiguity in a startup environment.

Responsibilities

  • Build API-based products from the ground up for leaderboards, models, and arenas.
  • Solve streaming problems with SSE and partial failure recovery.
  • Ship enterprise-grade infrastructure: rate limiting, auth, usage metering, audits, SOC 2.
  • Build observability with tracing, latency breakdowns, and dashboards.
  • Collaborate with researchers to turn ideas into products; no data labeling.
  • Contribute to backend of Leaderboards and Evals when needed.

Skills

Backend engineering
Distributed systems
Go
LLM APIs
Product mindset
Ambiguity tolerance

Tools

AWS / GCP / Azure
Kubernetes
Terraform
PostgreSQL
Redis

Job description

Arena Intelligence is hiring a Software Engineer - Platform to build the core infrastructure for online evaluation systems at scale in San Francisco. You’ll influence gateways, runtimes, and serving layers, collaborating with researchers and product leadership on zero-to-one and scale-it-up work.

You will bring 5+ years of backend experience, strong Go, and familiarity with LLM APIs, cloud infra, and developer-facing APIs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Platform Infrastructure Engineer for Scalable AI Gateways
Platform Infrastructure Engineer for Scalable AI Gateways

Arena • San Francisco (CA)

On-site
USD 140,000 - 230,000
Senior Platform Engineer — Go, APIs & AI Evaluation
Senior Platform Engineer — Go, APIs & AI Evaluation

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Equity
Health benefits
Competitive salary
+1
Software Engineer - Platform
Software Engineer - Platform

Arena • San Francisco (CA)

On-site
USD 140,000 - 230,000
Backend Platform Engineer – AI Gateway (Golang)
Backend Platform Engineer – AI Gateway (Golang)

People Culture Talent • San Francisco (CA)

On-site
USD 200,000 - 350,000
Comprehensive health, dental, vision
Visa sponsorship available
Equity opportunity
Software Engineer, Platform
Software Engineer, Platform

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive compensation & equity
Health & wellness benefits
Cutting-edge AI projects
+1
Software Engineer - Platform
Software Engineer - Platform

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Equity
Health benefits
Competitive salary
+1
Infrastructure Engineer
Infrastructure Engineer

People Culture Talent • San Francisco (CA)

On-site
USD 200,000 - 350,000
Comprehensive health, dental, vision benefits
Opportunity to work on cutting-edge AI
Culture of transparency and community impact
+1
ML Engineer - AI Evaluation & Benchmarking Platform
ML Engineer - AI Evaluation & Benchmarking Platform

Arena Intelligence, Inc. • California

On-site
USD 170,000 - 230,000
Comprehensive health benefits
Cutting-edge AI projects
Small, mission-driven team
Software Engineer - ML Infrastructure
Software Engineer - ML Infrastructure

Arena • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive pay
Equity
Health benefits
+2
Full-Stack Engineer: Build & Ship AI Evaluation Tools
Full-Stack Engineer: Build & Ship AI Evaluation Tools

Arena • San Francisco (CA)

On-site
USD 150,000 - 210,000
Competitive compensation
Equity
Health benefits
+2