Senior AI Systems Engineer: Backend & Orchestration

Remote

San Francisco (CA)

Remote

USD 215,000 - 250,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Stock options
Benefits

Job summary

Federato is seeking an Software Engineer, AI Systems to help build the backend architecture behind our agent systems. This role sits at the intersection of software engineering, data infrastructure, and applied AI.

You’ll design and implement systems that power LLM-driven product capabilities—from orchestration to production deployment. You’ll collaborate with product, design, and engineering teams to translate underwriting workflows into AI-enabled features and ship high-impact capabilities in

Qualifications

  • 10+ years of backend engineering, data engineering or related roles.
  • Strong experience building production backend systems and APIs.
  • Professional experience with LLMs, agent systems, or generative AI applications.
  • Hands-on experience with prompt design, tool-based agent architectures, or LLM workflows.
  • Proficiency in Python or similar backend languages.
  • Experience with cloud infrastructure and distributed systems.
  • Comfort working across layers of the stack from infra to product integration.
  • Strong curiosity about emerging AI architectures and agent patterns.
  • Ability to navigate ambiguity in a fast-paced, collaborative environment.

Responsibilities

  • Design and implement agent workflows and orchestration systems for AI-powered product features.
  • Build backend services that integrate LLMs with structured insurance data and platform APIs.
  • Develop infrastructure for tooling, context management, and agent execution.
  • Contribute to internal frameworks supporting prompt iteration, evaluation, and observability.
  • Partner with product and design to translate underwriting workflows into AI-enabled product experiences.
  • Help define architectural patterns for building reliable AI-native features in production.
  • Work across backend systems, data infrastructure, and product integrations to ship user-facing capabilities.

Skills

Backend engineering
LLMs experience
Prompt design
Python
Cloud infrastructure
Distributed systems
API development
Production-grade systems
Agent systems
Observability

Job description

Federato is seeking an Software Engineer, AI Systems to help build the backend architecture behind our agent systems. This role sits at the intersection of software engineering, data infrastructure, and applied AI.

You’ll design and implement systems that power LLM-driven product capabilities—from orchestration to production deployment. You’ll collaborate with product, design, and engineering teams to translate underwriting workflows into AI-enabled features and ship high-impact capabilities in

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Systems Engineer: Production Backend for Agent AI
Staff AI Systems Engineer: Production Backend for Agent AI

Federato • United States

Remote
USD 215,000 - 250,000
Stock options
Benefits
AI Systems Platform Engineer - LLM-Powered Backend & Orchestration
AI Systems Platform Engineer - LLM-Powered Backend & Orchestration

Federato Technologies • United States

Remote
USD 180,000 - 240,000
AI Systems Engineer - Backend for AI-Powered Insurance Platform
AI Systems Engineer - Backend for AI-Powered Insurance Platform

Federato • San Francisco (CA)

On-site
USD 215,000 - 250,000
Senior AI Backend Engineer – Enterprise-Scale Orchestration
Senior AI Backend Engineer – Enterprise-Scale Orchestration

Klarity • San Francisco (CA)

On-site
USD 220,000 - 280,000
Equity
Employer-Paid Medical
Parental Leave
+4
Staff Software Engineer, AI Systems
Staff Software Engineer, AI Systems

Federato • San Francisco (CA)

On-site
USD 215,000 - 250,000
Staff Software Engineer, AI Systems
Staff Software Engineer, AI Systems

Remote • San Francisco (CA)

Remote
USD 215,000 - 250,000
Stock options
Benefits
Staff Software Engineer, AI Systems
Staff Software Engineer, AI Systems

Federato Technologies • United States

On-site
USD 180,000 - 240,000
Senior Backend Engineer - AI/LLM & Microservices
Senior Backend Engineer - AI/LLM & Microservices

Coinbase, Inc. • New York (NY)

On-site
USD 150,000 - 210,000
Medical Insurance
Dental Insurance
Vision Insurance
+3
Lead AI Orchestration Engineer
Lead AI Orchestration Engineer

Interflex Datensysteme GesmbH • Carmel (IN)

Hybrid
USD 154,000 - 205,000
Health, dental and vision insurance
Unlimited PTO
401K with company match
+2
Senior AI Backend Engineer | Equity & Production AI
Senior AI Backend Engineer | Equity & Production AI

Within • San Francisco (CA)

On-site
USD 180,000 - 260,000
Equity
100% Employer-Paid Medical, Dental & 0
Paid Parental Leave
+6