Staff AI Platform Architect & Scale Engineer

fastino.ai

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Fastino is hiring a Staff Software Engineer in San Francisco to help shape the platform's technical direction and scale our AI-driven systems. You will design and build the agent harness, handle runtime loops, tool calling, and context management, while ensuring reliability and observability in production environments.

You will optimize AI training/inference pipelines, deploy within customer-managed AWS VPCs, and collaborate with researchers to move models from research to production, mentoring

Qualifications

  • 8+ years of hands-on software engineering, including time as a tech lead or driving architecture across a team or product.
  • Strong architectural skills with a track record of designing and scaling production systems under real load.
  • Production experience with agentic systems, AI training or inference pipelines.
  • Experience deploying software on AWS with Kubernetes and Terraform, ideally in customer-managed or multi-tenant environments.
  • Hands-on experience deploying sandboxed execution environments for agent workloads (Modal Sandboxes).
  • Experience building with AI coding agents and guiding them to produce production-grade code.
  • Thrives in ambiguity and makes strong calls without a fixed playbook.

Responsibilities

  • Define the technical direction and architecture for Fastino’s platform to scale efficiently.
  • Design and build the agent harness, runtime loop, tool calling, context management, and error recovery.
  • Scale AI training and inference pipelines focusing on latency, throughput, and cost as usage grows.
  • Deploy Fastino platform into customer-managed AWS VPCs using Kubernetes and Terraform with observability.
  • Create secure sandboxed environments for agent workloads on Modal Sandboxes.
  • Deliver full-stack features end-to-end while solving the toughest problems.
  • Collaborate with AI researchers to move models from research to production, including deployment and monitoring.
  • Mentor teammates, enforce coding standards, and define engineering practices.

Skills

Software engineering
System architecture
Agentic systems
AWS deployment
Kubernetes
Terraform
Sandboxed execution
AI coding agents
Code reviews/mentorship
Ambiguity handling

Tools

AWS
Kubernetes
Terraform
Modal Sandboxes
LangSmith
vLLM
Triton

Job description

Fastino is hiring a Staff Software Engineer in San Francisco to help shape the platform's technical direction and scale our AI-driven systems. You will design and build the agent harness, handle runtime loops, tool calling, and context management, while ensuring reliability and observability in production environments.

You will optimize AI training/inference pipelines, deploy within customer-managed AWS VPCs, and collaborate with researchers to move models from research to production, mentoring

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Platform Engineer: Scale LLM Pipelines
Staff AI Platform Engineer: Scale LLM Pipelines

Fastino, Inc. • San Francisco (CA)

On-site
USD 180,000 - 280,000
Staff SW Engineer
Staff SW Engineer

fastino.ai • San Francisco (CA)

On-site
USD 180,000 - 260,000
Customer-Facing AI Deployment Engineer
Customer-Facing AI Deployment Engineer

fastino.ai • San Francisco (CA)

On-site
USD 150,000 - 210,000
Staff SW Engineer
Staff SW Engineer

Fastino, Inc. • San Francisco (CA)

On-site
USD 180,000 - 280,000
Senior Agent Engineer — Architect Scalable AI Agents
Senior Agent Engineer — Architect Scalable AI Agents

fastino.ai • San Francisco (CA)

On-site
USD 180,000 - 240,000
Staff AI Platform Engineer - Lead AI Infra & Pipelines
Staff AI Platform Engineer - Lead AI Infra & Pipelines

Code Metal, Inc. • San Francisco (CA)

Hybrid
USD 205,000 - 250,000
Health care plan for employees
401k with matching
Paid Time Off
Staff AI DevEx Engineer: Platform & Tooling Leader
Staff AI DevEx Engineer: Platform & Tooling Leader

Neobankbeat • San Francisco (CA)

On-site
USD 180,000 - 260,000
Staff AI Platform Engineer: Scale ML Infra
Staff AI Platform Engineer: Scale ML Infra

DAT Freight Solutions • Seattle (WA)

Hybrid
USD 198,000 - 246,000
Medical Insurance
Dental Insurance
Vision Insurance
+6
Staff AI Engineer: Build Scalable AI Workers (NYC)
Staff AI Engineer: Build Scalable AI Workers (NYC)

Forgepoint • New York (NY)

On-site
USD 180,000 - 240,000
Top-tier salary and equity
Great healthcare
Dinner at the office
+2
Staff AI Platform Engineer: Build Scalable AI Core
Staff AI Platform Engineer: Build Scalable AI Core

The Wrap • New York (NY)

Hybrid
USD 197,000 - 247,000