Staff AI DevEx Engineer: Platform & Tooling

SoFi; San Francisco, Seattle (CA, WA); On-site; USD 180,000 - 280,000; Full time

Job summary

SoFi is seeking a Staff Software Engineer for our AI Platform team in San Francisco. You will own foundational platform systems across the AI Gateway, model routing, and the evaluation platform, and guide architecture aligned with product goals.

You will drive operational excellence, mentor engineers, and partner with cross-functional teams to deliver scalable AI tooling and developer experiences with strong security and reliability.

Qualifications

• Bachelor’s Degree + 3–4 Years of Experience OR Master’s Degree + 2–3 Years of Experience in software engineering, computer science, or a related field.
• Advanced programming expertise in at least one modern backend language (Java/Kotlin/Python/Go/Scala).
• Distributed systems expertise with trade-offs in security, concurrency, fault tolerance, scaling and idempotence.
• Track record of technical leadership guiding feature delivery and architecture on production platforms.
• Hands-on experience with AI-assisted developer tooling and LLM-based systems.

Responsibilities

• Own platform systems end-to-end: design, build, operate AI Gateway, model routing, eval platform, and harness vending.
• Instrument AI economics: develop usage telemetry, cost allocation, and chargeback mechanisms.

Skills

Java

Kotlin

Python

Go

Scala

Distributed systems

AWS

GCP

Docker

Kubernetes

CI/CD

AI tooling

Leadership

Communication

Education

Bachelor's Degree

Master's Degree

Tools

CI/CD tooling

Job description

SoFi is seeking a Staff Software Engineer for our AI Platform team in San Francisco. You will own foundational platform systems across the AI Gateway, model routing, and the evaluation platform, and guide architecture aligned with product goals.

You will drive operational excellence, mentor engineers, and partner with cross-functional teams to deliver scalable AI tooling and developer experiences with strong security and reliability.