Senior AI Systems Engineer, Runtime & Orchestration

Jobtailor

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Jobtailor in San Francisco, CA is seeking a senior software engineer to design and build scalable AI-enabled runtime systems. You will own features end-to-end, from runtime capability to user-facing experience, and collaborate with Product, Design, Sales Engineering, and Customer Success to turn ambitious ideas into production systems.

The role requires 7+ years of experience in distributed systems, AI applications with LLMs, and strong backend fundamentals, with a bias toward shipping and

Qualifications

  • 7+ years of software engineering experience building production systems.
  • Deep understanding of distributed systems and backend architecture.
  • Experience building AI applications using LLMs, agents, RAG, MCP, or modern AI frameworks.
  • Strong software engineering fundamentals including APIs, concurrency, testing, and system design.
  • Experience building developer platforms, orchestration systems, or workflow engines.
  • Ability to rapidly prototype while maintaining production quality.
  • Strong product instincts and comfort operating in ambiguous environments.
  • Exceptional written communication skills.
  • A bias toward ownership and shipping.

Responsibilities

  • Build the AI Runtime.
  • Design and implement the orchestration layer that turns natural-language intent into reliable execution.
  • Build systems for entity resolution, context assembly, connector orchestration, and evidence retrieval.
  • Develop reusable Skills that encapsulate business workflows and domain expertise.
  • Build routing systems that intelligently coordinate connectors, tools, deterministic logic, and multiple language models.
  • Build Products Users Trust.
  • Own features end-to-end, from runtime capability to user-facing experience.
  • Develop evidence-backed reasoning with citations and traceability that users can actually see and verify.
  • Build evaluation frameworks that continuously improve quality.
  • Implement permission models, freshness validation, and action policies that work transparently for end users.
  • Ship and Iterate.
  • Build prototypes, validate ideas, and rapidly iterate with customers.
  • Write high-leverage code that enables entire product areas.
  • Collaborate closely with Product, Design, Sales Engineering, and Customer Success to turn ambitious ideas into production systems.
  • Experiment with new agent architectures while maintaining production-grade reliability.

Skills

Distributed systems
Backend architecture
LLMs / AI frameworks
APIs
Concurrency
Testing
Ownership
Prototyping

Tools

Kafka
Postgres
Spark
LangGraph
Temporal

Job description

Jobtailor in San Francisco, CA is seeking a senior software engineer to design and build scalable AI-enabled runtime systems. You will own features end-to-end, from runtime capability to user-facing experience, and collaborate with Product, Design, Sales Engineering, and Customer Success to turn ambitious ideas into production systems.

The role requires 7+ years of experience in distributed systems, AI applications with LLMs, and strong backend fundamentals, with a bias toward shipping and

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Platform Engineer: LLM Orchestration & Scalable Backend
AI Platform Engineer: LLM Orchestration & Scalable Backend

Jobtailor • San Francisco (CA)

On-site
USD 140,000 - 180,000
Senior AI Platform Engineering Lead
Senior AI Platform Engineering Lead

Jobtailor • Santa Clara (CA)

On-site
USD 180,000 - 250,000
Senior AI-Driven Industrial Software Engineer
Senior AI-Driven Industrial Software Engineer

Jobtailor • Pennsylvania

On-site
USD 150,000 - 200,000
Senior AI Platform & Systems Engineering Lead
Senior AI Platform & Systems Engineering Lead

Jobtailor • Maryland

On-site
USD 180,000 - 240,000
Senior AI Systems Architect & Engineering Leader
Senior AI Systems Architect & Engineering Leader

Jobtailor • California (MO)

On-site
USD 180,000 - 280,000
Senior AI Architect: GenAI & Distributed Systems Lead
Senior AI Architect: GenAI & Distributed Systems Lead

Jobtailor • California (MO)

On-site
USD 180,000 - 240,000
Senior AI Engineer - Build GenAI-Driven Full-Stack Systems
Senior AI Engineer - Build GenAI-Driven Full-Stack Systems

Jobtailor • Minnesota

On-site
USD 130,000 - 170,000
Senior AI/ML Architect & Scalable ML Systems Lead
Senior AI/ML Architect & Scalable ML Systems Lead

Jobtailor • United States

On-site
USD 180,000 - 240,000
Senior AI Engineering Lead - Real-Time ML & Scalable Infra
Senior AI Engineering Lead - Real-Time ML & Scalable Infra

Jobtailor • Burbank (CA)

On-site
USD 180,000 - 240,000
Lead AI Engineer: Scalable ML & NLP Systems
Lead AI Engineer: Scalable ML & NLP Systems

Jobtailor • Reston (VA)

On-site
USD 140,000 - 210,000