Software Engineer - Baseten for Labs

Rozgoo

United States

Remote

USD 120,000 - 160,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Medical, dental and vision insurance
Flexible PTO including Winter Break
Parental leave
Fertility and family-building stipend
Learning/networking opportunities

Job summary

Baseten is building platform tools for AI labs and researchers in a fast-paced environment. You will own projects across API design, backend implementation, and frontend surfaces, shipping reliable multi-tenant features.

Join a high-ownership team focused on production-grade infrastructure, model APIs, and gateway services, with strong emphasis on observability and collaboration.

Qualifications

  • 4+ years building and operating production software, including full-stack experience.
  • Ability to take initiative and think about the "why" behind what you build.
  • Strong backend fundamentals: API design, distributed systems, observability, and operational rigor.
  • Comfort working across the stack: backend services, data pipelines, and user-facing surfaces.
  • Strong written communication and collaboration.
  • Curiosity about the AI/ML infrastructure space.

Responsibilities

  • Take ownership of projects from API design to frontend surfaces, rollout and operation.
  • Build backend services with high reliability: auth, rate limiting, quotas, metering, multi-tenant isolation.
  • Ship developer-facing surfaces: dashboards, onboarding flows, self-serve tooling.
  • Collaborate with design, product, and GTM to ship what labs and developers need.
  • Drive performance and reliability improvements through profiling, tracing, and load testing.

Skills

Full-stack development
Backend development
APIs
Distributed systems
Observability
Communication

Tools

React/TypeScript
Kubernetes
Billing/metering
Gateway/API management

Job description

ABOUT BASETEN Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $300M Series E , backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE

You'll join Baseten for Labs — a small, high-ownership team building the products that power how model labs and AI researchers ship and scale their models. This team moves fast and owns its outcomes end-to-end. This is a role for a full-stack, product-minded engineer who likes working across the whole surface area: from shaping a clean API or user-facing feature, to building the backend systems that run it reliably in production. You'll contribute across three interconnected product areas: Model Library — The place developers discover, evaluate, and deploy the right model for their use case. You'll build the browsing, evaluation, and onboarding experiences that help developers navigate an exploding model landscape. Inference API Gateway — A production-ready, white-labeled API gateway that lets model labs serve their models to customers under their own domain. You'll build the auth, key management, rate limiting, metering, and multi-tenant isolation that power it.

EXAMPLE INITIATIVES
  • Model APIs for frontier models
  • Model training built for production inference
  • Introducing the Baseten Frontier Gateway
RESPONSIBILITIES
  • Take meaningful ownership of projects: from API design and backend implementation to frontend surfaces, rollout, and operation.
  • Build backend services with high reliability and clear SLOs — auth, rate limiting, quotas, metering, and multi-tenant isolation.
  • Ship developer-facing product surfaces: dashboards, onboarding flows, and self-serve tooling that reduce time-to-value.
  • Collaborate closely with design, product, and GTM to define and ship what labs and developers actually need.
  • Drive performance and reliability improvements through profiling, tracing, and load testing.
REQUIREMENTS
  • 4+ years building and operating production software, including at least some full-stack experience (backend-primary is fine, but you're comfortable touching the frontend).
  • Demonstrated ability to take initiative and contribute beyond the spec — you think about the "why" behind what you build.
  • Strong backend fundamentals: API design, distributed systems, observability, and operational rigor.
  • Comfort working across the stack: backend services, data pipelines, and user-facing product surfaces.
  • Strong written communication — clear design docs, effective async collaboration.
  • Genuine curiosity about the AI/ML infrastructure space; you don't need ML expertise, but you want to understand the ecosystem.
NICE TO HAVE
  • Experience building developer-facing products: APIs, SDKs, CLIs, dashboards, or self-serve workflows.
  • Experience with API gateways, auth systems, billing/metering infrastructure, or multi-tenant platforms.
  • Frontend experience (React/TypeScript) or strong product UX instincts for developer tools.
  • Familiarity with model serving, LLM runtimes, or inference platforms.
  • Comfort with Kubernetes, distributed scheduling, or service mesh concepts.
BENEFITS
  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents.
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you. At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engineering Manager, Model Library
Engineering Manager, Model Library

Rozgoo • United States

Remote
USD 180,000 - 240,000
Equity
Medical/Dental/Vision
Flexible PTO
+3
Software Engineer - Inference Platform
Software Engineer - Inference Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Comprehensive medical for US
Flexible PTO
+4
Software Engineer- Inference Platform
Software Engineer- Inference Platform

Candidate • San Francisco (CA)

On-site
USD 170,000 - 210,000
Equity
Medical insurance
Flexible PTO
+3
Product Manager, Inference Platform
Product Manager, Inference Platform

Rozgoo • United States

Remote
USD 150,000 - 210,000
Equity
Health insurance (family)
Flexible PTO
+3
Software Engineer- Inference Platform
Software Engineer- Inference Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 360,000
Competitive equity
Medical insurance
Flexible PTO
+4
Software Engineer - Inference Platform
Software Engineer - Inference Platform

Baseten • New York (NY)

On-site
USD 180,000 - 360,000
Competitive compensation with equity
Medical, dental, and vision coverage
Flexible PTO with Winter Break
+4
Forward Deployed Engineer (Training)
Forward Deployed Engineer (Training)

The Consensus • New York (NY)

On-site
USD 120,000 - 170,000
Competitive compensation
Medical, dental, vision insurance
Flexible PTO
Software Engineer - Model Products
Software Engineer - Model Products

The Consensus • New York (NY)

On-site
USD 120,000 - 160,000
Competitive compensation including equity
100% coverage of medical, dental, and vision insurance
Flexible PTO policy
+3
Software Engineer - Infrastructure
Software Engineer - Infrastructure

Baseten • Seattle (WA)

On-site
USD 165,000 - 330,000
Competitive equity + compensation
Healthcare coverage for employee and 1
Flexible PTO including Winter Break
+4
Software Engineer - Partner Platform
Software Engineer - Partner Platform

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive compensation with equity
US medical, dental, and vision
Flexible PTO and company winter break
+3