Senior AI Engineer: Scalable Backend for AI Agents

Klaviyo Inc.; Boston (MA); Hybrid; USD 148,000 - 222,000; Full time

Job summary

Klaviyo is seeking a Senior AI Engineer for the Customer Agent team to design and build backend systems powering AI products and agents. You will work with product managers, ML engineers and data scientists to ship scalable AI-powered experiences for our customers.

You will influence architecture, async processing pipelines, distributed systems, and production-grade AI services while collaborating closely with cross-functional teams in a fast-paced startup-like environment.

Qualifications

• 5–7 years of software engineering with backend focus.
• Experience deploying generative AI apps to production.
• Proficient in Python and modern backend frameworks (FastAPI, Django).
• Experience with big data tools (Spark, Hadoop).
• Knowledge of asynchronous processing and distributed queues.

Responsibilities

• Design and build backend systems to scale AI solutions for 167K+ customers.
• Develop robust data pipelines for training and serving ML models.
• Build services to serve AI models in production environments.
• Contribute to evolving agentic architecture for self-sufficient AI agents.
• Foster ownership, experimentation, and customer-centric thinking.

Skills

Backend systems

Distributed architectures

Python

FastAPI/Django

AI model deployment

Prompt engineering

Spark/Hadoop

Async processing

Kubernetes

AWS

Tools

Apache Spark

Hadoop

Celery

Kafka

SQS

RabbitMQ

Redis

SQLAlchemy

Alembic

FastAPI

Django

Kubernetes

AWS

Job description

Klaviyo is seeking a Senior AI Engineer for the Customer Agent team to design and build backend systems powering AI products and agents. You will work with product managers, ML engineers and data scientists to ship scalable AI-powered experiences for our customers.

You will influence architecture, async processing pipelines, distributed systems, and production-grade AI services while collaborating closely with cross-functional teams in a fast-paced startup-like environment.