Software Engineer, Platform

Socket.dev

San Francisco (CA)

On-site

USD 200,000 - 350,000

Full time

6 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Health benefits
Visa sponsorship
Equity

Job summary

Socket.dev is seeking a Software Engineer, Platform to shape how AI models are evaluated and measured. This founding role will build backend infrastructure for an AI gateway and work closely with founders and early customers in San Francisco.

Requirements include 5+ years in backend engineering, strong Golang skills, and experience delivering reliable APIs and distributed systems. The role is onsite three days per week and offers equity and visa sponsorship.

Qualifications

  • 5+ years of experience in backend services, distributed systems, or developer-facing platforms.
  • Strong Golang experience; built and operated backend systems in production.
  • Experience designing reliable APIs, service integrations, or gateway/proxy-style systems.
  • For Senior: track record of owning and delivering important backend functionality end to end.

Responsibilities

  • Build and scale backend platform services for the AI gateway, turning prototypes into scalable, reliable services.
  • Solve streaming challenges: SSE, partial failure recovery, mid-stream fallback, and normalization across providers.
  • Ship platform infrastructure: authentication, rate limiting, usage metering, and cost tracking as the gateway matures.
  • Build deep observability with distributed tracing, latency breakdowns, and real-time dashboards for customers and the team.
  • Integrate with the evaluation platform and collaborate with research/product teams to ship reliable features.
  • Contribute across the stack, including backend work for Leaderboards and Evals as needed.

Skills

Golang
Backend services
Distributed systems
APIs
Cloud experience

Tools

GCP
AWS
Azure

Job description

Note: We are recruiting on behalf of our valued client. This opportunity is for a position with their organization, not with People Culture Talent. We're excited to help connect talented professionals with this exceptional team!

The Role

The open AI evaluation platform redefining how the world's leading AI labs measure model performance is looking for a Software Engineer, Platform to help shape the future of how the world measures artificial intelligence.

They are building an AI gateway that gives developers access to multiple model providers through a unified endpoint. The product is in a private, gated launch, with additional platform capabilities—including direct model access—being built next.

You’ll help build the platform infrastructure that turns their research advantage into enterprise products. This is a founding role on the developer team. You’ll work directly with the founders and early customers to define what they build and how they build it.

Location: San Francisco onsite three days per week. Remote candidates will generally only be considered with a strong endorsement.

What You’ll Do
  • Build and scale hands‑on backend platform services for client's AI gateway, evolving an existing prototype into a reliable, independently scalable service.
  • Solve hard streaming problems. Handle SSE/streaming responses across heterogeneous providers, including partial failure recovery, mid‑stream fallback, and consistent response normalization.
  • Ship reliable platform infrastructure, including capabilities such as authentication, rate limiting, usage metering, and cost tracking as the gateway matures.
  • Build deep observability. Instrument the platform with distributed tracing, latency breakdowns, usage tracking, and real‑time dashboards so customers (and the team) can see exactly what’s happening.
  • Build AI‑centered platform capabilities. Integrate with client's evaluation platform and data, and collaborate with research and product teams to turn new ideas into reliable product features.
  • Flex across the stack. Contribute to the backend of the company's Leaderboards and Evals products when needed, working across platform and product boundaries.
What We’re Looking For
  • 5+ years of professional software engineering experience, focused on backend services, distributed systems, or developer‑facing platforms.
  • Strong Golang experience is required. You have built and operated meaningful backend systems in production.
  • Experience designing reliable APIs, service integrations, or gateway/proxy‑style systems.
  • For Senior candidates: a track record of owning and delivering important backend functionality end to end.
  • For Staff candidates: extensive backend/platform experience, strong technical judgment, and the ability to provide hands‑on technical leadership.
  • Cloud experience with GCP, AWS, Azure, or another major provider is helpful but not required.
  • Comfortable working hands‑on in a fast‑moving environment where the product and infrastructure are still evolving.
  • Able to work from our San Francisco office three days per week.
Nice to Have
  • API gateway, proxy, or multi‑provider integration experience.
  • Experience with streaming APIs, response normalization, or resilient distributed systems.
  • Exposure to LLM APIs, model serving, AI infrastructure, or evaluation platforms.
  • Cloud infrastructure experience across GCP, AWS, Azure, Kubernetes, Terraform, Postgres, or Redis.
  • Experience building usage tracking, billing/metering, authentication, or developer tooling.
Compensation Band

Their openings span more than one career level. The starting salary for this role is $200k and could range up to $350k USD, plus equity. The provided salary depends on many factors, such as work experience and transferable skills, business needs and impact, and market demands.

Benefits
  • Comprehensive health, dental, vision, and additional support programs.
  • The opportunity to work on cutting‑edge AI with a small, mission‑driven team.
  • A culture that values transparency, trust, and community impact.
  • Visa sponsorship available.
About Our Client:

This fast‑growing startup is building technology that helps people better understand how AI models perform in real‑world settings. Its open evaluation platform provides researchers, developers, and organizations with meaningful insights into model quality and performance.

Through crowdsourced benchmarks and human preference data, the company helps inform important decisions about the development and use of artificial intelligence. Its evaluation tools and leaderboards have become trusted resources within the AI community.

Behind the platform is a team of experienced researchers, engineers, and builders who seek truth, move quickly, and care deeply about craftsmanship and impact. They’re building a company where deep expertise meets curiosity and where the work genuinely matters.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Infrastructure Engineer
Infrastructure Engineer

People Culture Talent • San Francisco (CA)

On-site
USD 200,000 - 350,000
Comprehensive health, dental, vision benefits
Opportunity to work on cutting-edge AI
Culture of transparency and community impact
+1
Product Solutions Engineer
Product Solutions Engineer

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Competitive compensation
Comprehensive health and wellness benefits
Opportunity to work on cutting-edge AI
+1
Senior AI Engineer
Senior AI Engineer

People In AI • San Francisco (CA)

On-site
USD 180,000 - 240,000
Backend Software Engineer (Evals)
Backend Software Engineer (Evals)

OpenAI • Los Angeles (CA)

On-site
USD 230,000 - 385,000
Applied AI Engineer
Applied AI Engineer

Arena • San Francisco (CA)

On-site
USD 150,000 - 210,000
Competitive compensation
Equity
Health benefits
+1
Senior Software Engineer, Product
Senior Software Engineer, Product

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 110,000 - 160,000
Competitive compensation
Comprehensive health benefits
Opportunity to work on cutting-edge AI
+1
Applied AI Engineer
Applied AI Engineer

Arena Intelligence, Inc. • San Francisco (CA)

On-site
USD 140,000 - 210,000
Competitive compensation & equity
Health benefits
Cutting-edge AI projects
+1
Applied AI Engineer
Applied AI Engineer

Precision Labs • Northern (KY)

Hybrid
USD 110,000 - 170,000
Competitive compensation & equity
Health & wellness benefits
Work on cutting‑edge AI
+1
Senior Software Engineer, ML Infrastructure
Senior Software Engineer, ML Infrastructure

Arena Intelligence • Bay (AR)

On-site
USD 120,000 - 180,000
Equity
Health benefits
Work on cutting-edge AI
Senior Software Engineer - Research Platform, Consumer Devices
Senior Software Engineer - Research Platform, Consumer Devices

OpenAI • San Francisco (CA)

Hybrid
USD 293,000 - 325,000