Staff SW Engineer

Fastino, Inc.; San Francisco (CA); Sur place; USD 180 000 - 280 000; Plein temps

Résumé du poste

Fastino, Inc. is hiring a Staff Software Engineer in San Francisco to define the platform's technical direction and scale our AI systems.

You will design and build the agent harness, runtime loop, and eval harnesses, while scaling training and inference pipelines for latency and cost efficiency. You will deploy into customer-managed AWS VPCs using Kubernetes and Terraform, and create secure sandboxed environments for agent workloads on Modal Sandboxes.

Qualifications

• 8+ years of hands-on software engineering, with leadership across a team or product.
• Strong architectural skills with a track record of scaling production systems.
• Production experience with agentic AI training/inference pipelines.
• Hands-on experience deploying software on AWS with Kubernetes and Terraform.
• Experience building sandboxed execution environments for agent workloads, ideally with Modal Sandboxes.
• Experience building with AI coding agents to produce production-quality code.
• Thrives in ambiguity and balances fast delivery with long-term robustness.
• Optional: agent harnesses or inference tooling experience.

Responsabilités

• Define the technical direction for Fastino’s platform and scale the architecture.
• Design and build the agent harness, runtime loop, tool calling, context management, and eval harnesses.
• Scale AI training and inference pipelines focusing on latency, throughput, and cost.
• Deploy the Fastino platform into customer-managed AWS VPCs using Kubernetes and Terraform.
• Create secure sandboxed environments for agent workloads on Modal Sandboxes.
• Deliver end-to-end features while solving complex, ambiguous problems.
• Collaborate with AI researchers to take models from research to production, including monitoring.
• Mentor teams, enforce coding standards, and shape best practices for AI coding agents.
• Engage with customers and translate feedback into product decisions.

Connaissances

Hands-on software eng

Software architecture

Production AI systems

Ambiguity tolerance

Outils

AWS

Kubernetes

Terraform

Modal Sandboxes

LangSmith

vLLM

Triton

Description du poste

Staff Software Engineer

Full-time | San Francisco

Introduction:

• Join us at Fastino as we build the next generation of LLMs. Our team, boasting alumni from Google Research, Apple, Stanford, and Cambridge, is on a mission to develop specialized, efficient AI.

• Fastino's GLiNER family of open source models has been downloaded more than 50 million times and is used by companies such as NVIDIA, Meta, and Airbnb

• Fastino has raised $25M (as featured in TechCrunch) through our seed round and is backed by leading investors including Microsoft, Khosla Ventures, Insight Partners, GitHub CEO Thomas Dohmke, Docker CEO Scott Johnston, and others.

What You’ll Work On:

• Help define the technical direction for Fastino’s platform, contributing to the architecture decisions that let us scale without slowing down.

• Design and build our agent harness, including the runtime loop, tool calling, context management, and error recovery, plus the eval harnesses that measure agent reliability.

• Build and scale our AI training and inference pipelines, pushing on latency, throughput, and cost as usage grows.

• Own deployment of the Fastino platform into customer-managed AWS VPCs using Kubernetes and Terraform, including install, upgrade, and observability paths that work in environments we don't control.

• Build secure sandboxed execution environments for agentic workloads on Modal Sandboxes.

• Ship full-stack features end-to-end while owning the hardest, most ambiguous problems on the team.

• Partner closely with AI researchers to take new models from research to production, including deployment, evaluation, and monitoring.

• Raise the engineering bar through code reviews, mentorship, and setting practices the rest of the team builds on, including how we work with AI coding agents.

• Talk to customers and turn their feedback into product decisions, fast.

What We’re Looking For:

• Required: 8+ years of hands‑on software engineering experience, including time as a tech lead or driving architecture across a team or product.

• Required: Strong architectural skills, with a track record of designing and scaling production systems that handle real load.

• Required: Production experience with agentic systems, AI training pipelines, or inference pipelines, ideally more than one.

• Required: Hands‑on experience deploying software on AWS with Kubernetes and Terraform, ideally into customer‑managed or multi‑tenant environments.

• Required: Experience building and running sandboxed execution environments for agent workloads, ideally with Modal Sandboxes.

• Required: Extensive experience building with AI coding agents, and a demonstrated ability to guide them to produce clean, production‑quality code. You know how to scope tasks, review output critically, and catch what agents get wrong.

• Required: You thrive in ambiguity, make good calls without a playbook, and know when to move fast versus when to build for the long term.

• Optional: Experience building agent harnesses or frameworks used in production, including familiarity with MCP or similar tool protocols.

• Optional: Experience with LangSmith or similar tooling for tracing, evaluating, and monitoring agents.

• Optional: Hands‑on experience with inference optimization, like batching, quantization, GPU utilization, or serving frameworks such as vLLM, SGLang, or Triton.

• Optional: Deep experience with high‑concurrency backend systems or low‑latency API design.

• Optional: Startup experience, ideally as an early engineer helping a team grow.