AI Engineer

Baseten

San Francisco, Northern (CA, KY)

Hybrid

USD 180,000 - 270,000

Full time

5 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity
Medical, dental, vision coverage
Flexible PTO, Winter Break
Parental leave
Fertility stipend
401(k)
Learning opportunities

Job summary

Baseten is seeking an AI Engineer for our Training Product team in San Francisco to build AI-driven features for customer training workflows. You will work with research engineers to turn ideas into customer-ready products, shipping end-to-end solutions and raising Baseten's internal AI capabilities.

You will own the design of harnesses, guardrails, and automation, collaborating across API, backend, and frontend, to deliver reliable agent-based experiences.

Qualifications

  • 5+ years of software development experience.
  • Proven track record creating AI/LLM-enabled products and agentic workflows.
  • Strong fundamentals in software engineering; able to clear a technical bar.
  • Fluency in Python; proficiency in at least one other language.
  • Ability to work autonomously in a fast-moving environment.
  • Ability to bridge customer-facing product work and internal tooling.

Responsibilities

  • Build and ship agentic product experiences, from prototype to GA.
  • Design harnesses, execution flows, and guardrails for reliable AI systems in production.
  • Build internal automation and AI tooling to speed engineering, research, and go-to-market teams.
  • Partner with research engineers to scope opportunities from internal workflows into customer features.
  • Define and instrument evals to measure output quality improvements.
  • Work across API, backend, agent orchestration, and frontend to implement end-to-end features.
  • Use Baseten’s training and inference products to understand customer workflows.
  • Identify where AI can replace manual processes and build the solution.

Skills

5+ years experience
AI/LLM products
Python
Other language
Strong communication
Autonomy in fast-moving environment

Job description

ABOUT BASETEN

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE:

Are you the person on your team who builds the agent everyone else ends up using? We're looking for an AI Engineer to join our Training Product team and do that at Baseten. You'll build AI-driven product features for the customers training and post-training frontier models on our platform, and you'll raise the ceiling on how Baseten itself uses AI internally, turning manual workflows into agentic ones that make every other team faster.

You'll work directly with our research engineers to scope and build products, taking ideas from a research loop that already works internally to something customers can run themselves. This is a hands-on role with real autonomy. You'll pick the problems worth solving, build the harnesses, execution flows, and guardrails that make AI systems reliable, and own the results. If you've been shipping agents and want that to be the job, let's talk.

EXAMPLE INITIATIVES:

Take a look at these blog posts written by members of our team:

  • Baseten Training: an autoresearch substrate
  • Introducing Baseten Loops
  • Harnesses are everything. Here's how to optimize yours.
  • Building with NVIDIA Nemotron 3 Ultra and LangChain Deep Agents Code on Baseten
RESPONSIBILITIES:
  • Build and ship agentic product experiences, including chat-style and assistant-like interfaces, from prototype to GA.
  • Design the harnesses, execution flows, and guardrails that make AI systems reliable in production.
  • Build internal automation and AI tooling that measurably increases the velocity of engineering, research, and go-to-market teams.
  • Partner with research engineers to scope product opportunities out of internal research workflows and turn them into customer-facing features.
  • Define and instrument evals so you know whether a change actually improved output quality.
  • Work throughout the stack (API layer, backend, agent orchestration, frontend) to implement features end to end.
  • Use Baseten's own training and inference products yourself to develop intuition around customer workflows.
  • Identify where AI can replace manual process across the company and build the thing rather than write the proposal.
  • Fix bugs and resolve customer issues with urgency.
REQUIREMENTS:
  • 5+ years of experience building and shipping software applications.
  • Demonstrated experience building AI or LLM-powered products, agents, or agentic workflows that real users depend on.
  • Strong software engineering fundamentals and the ability to clear a real technical bar, not just prompt well.
  • Ability to build accurate mental models of how systems work under the hood, including the models and harnesses you're building on.
  • Proficiency in Python, with fluency in at least one other language.
  • Comfort working autonomously in a fast-moving environment with limited structure.
  • Ability to move between customer-facing product work and internal tooling and automation.
  • Strong communication skills, with the ability to bridge technical depth and business needs.
NICE TO HAVE:
  • Experience as a founding engineer or early employee at a startup.
  • Experience building evals, agent observability, or tooling for non-deterministic systems.
  • Familiarity with agent frameworks and harnesses (LangChain, Claude Code, Codex, OpenCode, MCP).
  • Experience with model development methods like supervised fine-tuning, reinforcement learning, synthetic data generation, LoRA, and full fine-tunes.
  • Frontend fluency.
BENEFITS
  • Competitive compensation, including meaningful equity.
  • 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Engineer
AI Engineer

Neura Market • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 260,000
Competitive compensation + equity
Medical, dental, vision insurance for
Flexible PTO including Winter Break
+3
AI Engineer
AI Engineer

Triwill Group • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
Equity
Comprehensive health coverage
Flexible PTO
+4
Software Engineer - AI Enablement
Software Engineer - AI Enablement

Baseten • San Francisco (CA)

On-site
USD 180,000 - 240,000
Competitive compensation and equity
100% medical, dental, and vision insurance
Generous PTO policy
+3
Software Engineer - AI Developer Productivity
Software Engineer - AI Developer Productivity

BaseTen • New York (NY), San Francisco (CA)

On-site
USD 180,000 - 260,000
Medical coverage
Dental coverage
Vision coverage
+3
Software Engineer - AI Enablement
Software Engineer - AI Enablement

Baseten • San Francisco (CA)

On-site
USD 150,000 - 230,000
100% medical, dental, and vision insurance coverage
Generous PTO policy including Winter Break
Paid parental leave
+2
Software Engineer - AI Enablement
Software Engineer - AI Enablement

Baseten • New York (NY)

On-site
USD 165,000 - 330,000
Competitive compensation with equity
Full medical, dental, and vision coverage
Generous PTO including Winter Break
+3
Software Engineer - Training Product
Software Engineer - Training Product

Baseten • San Francisco (CA)

On-site
USD 110,000 - 150,000
Competitive compensation, including equity.
100% medical coverage.
Generous PTO policy.
+1
AI Inference Engineer
AI Inference Engineer

BaseTen • New York (NY), San Francisco (CA)

Hybrid
USD 140,000 - 210,000
Equity
Healthcare coverage
Flexible PTO & Winter Break
+4
AI Inference Engineer
AI Inference Engineer

The Consensus • San Francisco (CA)

On-site
USD 130,000 - 190,000
Competitive equity and compensation
100% health, dental, vision insurance
Flexible PTO including Winter Break
+4
Software Engineer - Training Product
Software Engineer - Training Product

The Consensus • New York (NY)

On-site
USD 120,000 - 150,000
Competitive compensation with equity
100% medical, dental, and vision insurance
Flexible PTO including a Winter Break