Staff SW Engineer

fastino.ai

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Fastino is hiring a Staff Software Engineer in San Francisco to help shape the platform's technical direction and scale our AI-driven systems. You will design and build the agent harness, handle runtime loops, tool calling, and context management, while ensuring reliability and observability in production environments.

You will optimize AI training/inference pipelines, deploy within customer-managed AWS VPCs, and collaborate with researchers to move models from research to production, mentoring

Qualifications

  • 8+ years of hands-on software engineering, including time as a tech lead or driving architecture across a team or product.
  • Strong architectural skills with a track record of designing and scaling production systems under real load.
  • Production experience with agentic systems, AI training or inference pipelines.
  • Experience deploying software on AWS with Kubernetes and Terraform, ideally in customer-managed or multi-tenant environments.
  • Hands-on experience deploying sandboxed execution environments for agent workloads (Modal Sandboxes).
  • Experience building with AI coding agents and guiding them to produce production-grade code.
  • Thrives in ambiguity and makes strong calls without a fixed playbook.

Responsibilities

  • Define the technical direction and architecture for Fastino’s platform to scale efficiently.
  • Design and build the agent harness, runtime loop, tool calling, context management, and error recovery.
  • Scale AI training and inference pipelines focusing on latency, throughput, and cost as usage grows.
  • Deploy Fastino platform into customer-managed AWS VPCs using Kubernetes and Terraform with observability.
  • Create secure sandboxed environments for agent workloads on Modal Sandboxes.
  • Deliver full-stack features end-to-end while solving the toughest problems.
  • Collaborate with AI researchers to move models from research to production, including deployment and monitoring.
  • Mentor teammates, enforce coding standards, and define engineering practices.

Skills

Software engineering
System architecture
Agentic systems
AWS deployment
Kubernetes
Terraform
Sandboxed execution
AI coding agents
Code reviews/mentorship
Ambiguity handling

Tools

AWS
Kubernetes
Terraform
Modal Sandboxes
LangSmith
vLLM
Triton

Job description

Staff Software Engineer

Full-time | San Francisco

Introduction:
  • Join us at Fastino as we build the next generation of LLMs. Our team, boasting alumni from Google Research, Apple, Stanford, and Cambridge, is on a mission to develop specialized, efficient AI.

  • Fastino's GLiNER family of open source models has been downloaded more than 50 million times and is used by companies such as NVIDIA, Meta, and Airbnb

  • Fastino has raised $25M (as featured in TechCrunch) through our seed round and is backed by leading investors including Microsoft, Khosla Ventures, Insight Partners, GitHub CEO Thomas Dohmke, Docker CEO Scott Johnston, and others.

What You’ll Work On:
  • Help define the technical direction for Fastino’s platform, contributing to the architecture decisions that let us scale without slowing down.

  • Design and build our agent harness, including the runtime loop, tool calling, context management, and error recovery, plus the eval harnesses that measure agent reliability.

  • Build and scale our AI training and inference pipelines, pushing on latency, throughput, and cost as usage grows.

  • Own deployment of the Fastino platform into customer-managed AWS VPCs using Kubernetes and Terraform, including install, upgrade, and observability paths that work in environments we don't control.

  • Build secure sandboxed execution environments for agentic workloads on Modal Sandboxes.

  • Ship full-stack features end-to-end while owning the hardest, most ambiguous problems on the team.

  • Partner closely with AI researchers to take new models from research to production, including deployment, evaluation, and monitoring.

  • Raise the engineering bar through code reviews, mentorship, and setting practices the rest of the team builds on, including how we work with AI coding agents.

  • Talk to customers and turn their feedback into product decisions, fast.

What We’re Looking For:
  • Required: 8+ years of hands‑on software engineering experience, including time as a tech lead or driving architecture across a team or product.

  • Required: Strong architectural skills, with a track record of designing and scaling production systems that handle real load.

  • Required: Production experience with agentic systems, AI training pipelines, or inference pipelines, ideally more than one.

  • Required: Hands‑on experience deploying software on AWS with Kubernetes and Terraform, ideally into customer‑managed or multi‑tenant environments.

  • Required: Experience building and running sandboxed execution environments for agent workloads, ideally with Modal Sandboxes.

  • Required: Extensive experience building with AI coding agents, and a demonstrated ability to guide them to produce clean, production‑quality code. You know how to scope tasks, review output critically, and catch what agents get wrong.

  • Required: You thrive in ambiguity, make good calls without a playbook, and know when to move fast versus when to build for the long term.

  • Optional: Experience building agent harnesses or frameworks used in production, including familiarity with MCP or similar tool protocols.

  • Optional: Experience with LangSmith or similar tooling for tracing, evaluating, and monitoring agents.

  • Optional: Hands‑on experience with inference optimization, like batching, quantization, GPU utilization, or serving frameworks such as vLLM, SGLang, or Triton.

  • Optional: Deep experience with high‑concurrency backend systems or low‑latency API design.

  • Optional: Startup experience, ideally as an early engineer helping a team grow.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff SW Engineer
Staff SW Engineer

Fastino, Inc. • San Francisco (CA)

On-site
USD 180,000 - 280,000
Distinguished Agent Engineer
Distinguished Agent Engineer

fastino.ai • San Francisco (CA)

On-site
USD 180,000 - 240,000
Forward Deployed Engineer
Forward Deployed Engineer

fastino.ai • San Francisco (CA)

On-site
USD 150,000 - 210,000
Software Engineer - Large Language Models
Software Engineer - Large Language Models

Fastino Labs • San Francisco (CA)

Remote
GBP 65,000 - 90,000
Staff Software Engineer - AI/ML Platform
Staff Software Engineer - AI/ML Platform

Fanatics • San Francisco (CA)

On-site
USD 190,000 - 280,000
Full Stack Developer - Python/Flask/FastAPI & LLM & React
Full Stack Developer - Python/Flask/FastAPI & LLM & React

RLink Solutions LLC • Chicago (IL)

Hybrid
USD 140,000 - 200,000
Software Engineer - Full Stack San Francisco
Software Engineer - Full Stack San Francisco

FriendliAI Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Flexible hours
Lunch/dinner provided
Unlimited snacks
+4
Member of Technical Staff - Product (Backend)
Member of Technical Staff - Product (Backend)

Modal Labs • San Francisco (CA)

On-site
USD 140,000 - 190,000
Lead Fullstack AI Engineer
Lead Fullstack AI Engineer

NetWeb Software • United States

Remote
USD 180,000 - 240,000
Full Stack Developer PythonFlaskFastAPI LLM React
Full Stack Developer PythonFlaskFastAPI LLM React

RLink Solutions LLC • Chicago (IL)

Hybrid
USD 150,000 - 210,000