Senior AI Orchestration Engineer

Klaviyo; Boston (MA); On-site; USD 216,000 - 324,000; Full time

Job summary

Klaviyo in Boston seeks a Sr. Lead Software Engineer to architect and scale our Core Orchestration platform, delivering high-traffic, low-latency services with reliability. You will drive AI-driven workflows and shape the platform's long-term architecture.

You'll lead a distributed backend team, mentor engineers, collaborate with PMs, data science, and executives, and champion best practices in AI-native development, testing, and observability as our hub expands globally.

Qualifications

• 8+ years of professional software engineering experience focused on distributed systems and high-availability backend platforms.
• Hands-on with AI-driven workflows, RAG, or agentic frameworks.
• Experience designing event-driven architectures and scalable pipelines.
• Proficiency in Python and frameworks like FastAPI or Django.
• Strong AWS, Kubernetes, CI/CD, and observability experience.
• Ability to establish automated eval frameworks balancing latency, accuracy, cost, and safety.
• Proven cross-functional leadership and clear communication.

Responsibilities

• Architect and scale the Core Orchestration platform for high-traffic workloads.
• Drive technical vision for AI-driven agentic workflows and automated decisions.
• Lead adoption of AI-native development practices to boost productivity.
• Design foundational frameworks and mentor teams through reviews.
• Collaborate with PMs, data science, design, and leaders to shape roadmaps.

Skills

Backend leadership

AI & agentic systems

Distributed systems

Python & tooling

Cloud infrastructure

Quality & evals

Cross-functional influencer

Collaborative mindset

AI-first engineering

Customer-centric design

Tools

AWS

Kubernetes

Kafka

Celery

SQS

Redis

FastAPI

Django

Job description

Klaviyo in Boston seeks a Sr. Lead Software Engineer to architect and scale our Core Orchestration platform, delivering high-traffic, low-latency services with reliability. You will drive AI-driven workflows and shape the platform's long-term architecture.

You'll lead a distributed backend team, mentor engineers, collaborate with PMs, data science, and executives, and champion best practices in AI-native development, testing, and observability as our hub expands globally.