Senior Software Engineer, Engine & Distributed Systems

Stack Ai

United States

On-site

USD 170,000 - 260,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

StackAI is seeking a Senior Software Engineer, Engine & Distributed Systems to own the core execution engine and the durable runtime at the heart of the platform. You will design and implement the execution model, scheduling, and per-agent parallelization to ensure correctness at scale.

You’ll work with Python, FastAPI, and PostgreSQL, driving reliability and throughput for AI agent workflows. This is a hands-on, systems‑level role in a lean, high‑impact team.

Qualifications

  • 5+ years building backend systems in production.
  • Experience with durable execution or workflow orchestration (Temporal, Cadence).
  • Strong concurrency, queuing, retries, and fault tolerance under load.
  • Proficiency in Python and modern backend frameworks (FastAPI) with PostgreSQL fundamentals.
  • Focus on correctness and reliability.

Responsibilities

  • Own the execution engine, runtime scheduling, and sub-agent parallelization.
  • Build checkpointing, resumption, and recovery for durable workflows.
  • Shape the execution model for synchronous vs asynchronous workloads.
  • Ensure scale with health targets for latency and throughput.
  • Keep the engine extensible to ecosystem by supporting new harnesses and frameworks.

Skills

Backend systems
Distributed systems
Python
FastAPI
Concurrency
Durability
Idempotency
State machines

Education

BS/MS in Computer Science

Tools

Temporal
Cadence
PostgreSQL
API frameworks

Job description

About the Company

StackAI (by Asana) is a no-code AI workflow platform that empowers companies to build, deploy, and scale AI-powered workflows easily. With thousands of users and rapidly growing enterprise adoption, our mission is to democratize access to LLMs and bring AI into the hands of every business operator, not just developers. An Asana Company, we're building the foundational platform for the AI-driven future of work

The role

Enterprises run real work on AI agents, and at StackAI that work runs on a single engine. Some agents finish in a second. Others run for days, fan out into dozens of sub-agents, pause, resume, and recover from failures without losing a step. We're hiring a Senior Software Engineer, Engine & Distributed Systems to own that engine: the durable runtime at the core of the platform that has to be correct every time, at any scale.

This is deep systems work at the heart of the product. When the engine is solid, agents simply run — and getting it there is one of the more interesting distributed-systems problems in AI today. You'll own it end to end, from the execution model to how it behaves in production.

What you'll do
  • Own the execution engine. The runtime, scheduling, and sub-agent parallelization that run every agent on the platform.

  • Make long-running work durable. Build checkpointing, resumption, and recovery so agents survive failures and restarts and pick up exactly where they left off.

  • Shape the execution model. Decide how work is scheduled, queued, and moved from synchronous to asynchronous, so the platform stays correct and responsive as load grows.

  • Engineer for scale and reliability. Hold the engine to strict health targets for worker freshness, deploy safety, and drain time, and keep latency and throughput strong as volume grows.

  • Keep the engine open to the ecosystem. Make it straightforward to bring new agent harnesses, orchestration frameworks, and model capabilities into the runtime.

What we're looking for
  • 5+ years building backend systems in production, with real depth in distributed systems.

  • Hands-on experience with durable execution or workflow orchestration (Temporal, Cadence, or equivalent), with a way of thinking rooted in idempotency, state machines, and failure recovery.

  • Strong command of concurrency, queueing, retries, and fault tolerance under load.

  • Strong in Python and modern backend frameworks (FastAPI or similar), with sound database fundamentals (Postgres or similar).

  • You're drawn to the correctness problems that everything else quietly depends on.

Distributed systems is broad. If you're strong on most of this and excited to grow into the rest, we'd like to hear from you, even if you don't check every box.

Bonus points
  • Operating Temporal at scale.

  • Event-driven architectures and message queues.

  • Experience with PydanticAI, LangGraph, or similar.

  • AI or agent runtimes: tool-calling, sub-agent orchestration, streaming.

  • Performance and cost optimization of high-throughput backends.

  • Startup or growth-stage experience.

Why StackAI

You'll join a lean, high-impact team and own the engine that every customer's agents run on. Your work ships fast and is felt across the whole product.

Stack AI is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Software Engineer, Engine & Distributed Systems
Senior Software Engineer, Engine & Distributed Systems

StackAI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Senior Software Engineer, Engine & Distributed Systems
Senior Software Engineer, Engine & Distributed Systems

StackAI • New York (NY)

On-site
USD 202,000 - 230,000
Senior Software Engineer, Engine & Distributed Systems
Senior Software Engineer, Engine & Distributed Systems

Stack AI, Inc. • New York (NY)

On-site
USD 120,000 - 160,000
Senior Engine & Distributed Systems Engineer
Senior Engine & Distributed Systems Engineer

Stack Ai • United States

On-site
USD 170,000 - 260,000
Senior Engine & Distributed Systems Engineer
Senior Engine & Distributed Systems Engineer

Stack AI, Inc. • New York (NY)

On-site
USD 120,000 - 160,000
Senior Engine & Distributed Systems Engineer
Senior Engine & Distributed Systems Engineer

StackAI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Senior Engine & Distributed Systems Engineer – AI Workflows
Senior Engine & Distributed Systems Engineer – AI Workflows

StackAI • New York (NY)

On-site
USD 202,000 - 230,000
Platform Engineer, APIs & Observability
Platform Engineer, APIs & Observability

Stack Ai • United States

On-site
USD 120,000 - 180,000
Platform Engineer, APIs – Observability
Platform Engineer, APIs – Observability

StackAI • San Francisco (CA)

On-site
USD 120,000 - 160,000
Software Engineer - AI Agent Platforms
Software Engineer - AI Agent Platforms

Workato • San Francisco (CA)

On-site
USD 140,000 - 200,000