Platform Engineer - AI Gateway & Backend

Socket.dev; San Francisco (CA); On-site; USD 200,000 - 350,000; Full time

Benefits offered by this job

Health benefits

Visa sponsorship

Equity

Job summary

Socket.dev is seeking a Software Engineer, Platform to shape how AI models are evaluated and measured. This founding role will build backend infrastructure for an AI gateway and work closely with founders and early customers in San Francisco.

Requirements include 5+ years in backend engineering, strong Golang skills, and experience delivering reliable APIs and distributed systems. The role is onsite three days per week and offers equity and visa sponsorship.

Qualifications

• 5+ years of experience in backend services, distributed systems, or developer-facing platforms.
• Strong Golang experience; built and operated backend systems in production.
• Experience designing reliable APIs, service integrations, or gateway/proxy-style systems.
• For Senior: track record of owning and delivering important backend functionality end to end.

Responsibilities

• Build and scale backend platform services for the AI gateway, turning prototypes into scalable, reliable services.
• Solve streaming challenges: SSE, partial failure recovery, mid-stream fallback, and normalization across providers.
• Ship platform infrastructure: authentication, rate limiting, usage metering, and cost tracking as the gateway matures.
• Build deep observability with distributed tracing, latency breakdowns, and real-time dashboards for customers and the team.
• Integrate with the evaluation platform and collaborate with research/product teams to ship reliable features.
• Contribute across the stack, including backend work for Leaderboards and Evals as needed.

Skills

Golang

Backend services

Distributed systems

APIs

Cloud experience

Tools

GCP

AWS

Azure

Job description

Socket.dev is seeking a Software Engineer, Platform to shape how AI models are evaluated and measured. This founding role will build backend infrastructure for an AI gateway and work closely with founders and early customers in San Francisco.

Requirements include 5+ years in backend engineering, strong Golang skills, and experience delivering reliable APIs and distributed systems. The role is onsite three days per week and offers equity and visa sponsorship.