Software Engineer – AI-Powered Conversational Platforms

Klaviyo; Boston (MA); On-site; USD 116,000 - 174,000; Full time

Job summary

Klaviyo is seeking a Software Engineer for Conversational Products & Agent Workflows to join the Customer Agent team. You will help build scalable backend systems and AI-powered experiences that empower agents to retrieve context, use tools, and take reliable action for customers.

This backend-heavy role offers opportunities to contribute to user-facing experiences while owning meaningful pieces of large systems, shaping technical decisions, and expanding expertise in backend engineering and

Qualifications

• 3+ years of professional software engineering experience building backend systems or distributed applications.
• Hands-on experience with generative AI or agentic AI applications in production.
• Proficient in Python with FastAPI or Django.
• Experience with asynchronous/distributed systems (Celery, Kafka, SQS, RabbitMQ, Redis).
• Knowledge of databases, APIs, and production persistence.
• Comfort with AWS, containers, Kubernetes, CI/CD.
• Experience working with external customers.

Responsibilities

• Build and improve reliable backend systems and APIs that power AI-driven customer experiences.
• Develop production agentic features involving tool use, context management, retrieval, structured outputs, orchestration, and multi-step workflows.
• Contribute to solving applied AI problems across retrieval and RAG, grounding, hallucination mitigation, model selection, and choosing between LLM-based, deterministic, or hybrid approaches.
• Build and use evaluation approaches including representative datasets, automated and human evaluation, regression testing, qualitative error analysis, and production signals.
• Improve system reliability through guardrails, retries, fallbacks, observability, monitoring, and thoughtful failure handling.
• Build asynchronous and distributed processing workflows that support AI workloads at scale.
• Participate in an on-call rotation and help diagnose, mitigate, and learn from production incidents.
• Work with external customers and cross-functional partners to understand workflows, identify pain points, and translate feedback into product improvements.
• Monitor shipped experiences and use quality metrics, system performance, and customer feedback to guide iteration.

Skills

3+ years

Generative AI

Python

Async processing

Tools

FastAPI

Django

Celery

Kafka

SQS

RabbitMQ

Redis

AWS

Kubernetes

CI/CD

Job description

Klaviyo is seeking a Software Engineer for Conversational Products & Agent Workflows to join the Customer Agent team. You will help build scalable backend systems and AI-powered experiences that empower agents to retrieve context, use tools, and take reliable action for customers.

This backend-heavy role offers opportunities to contribute to user-facing experiences while owning meaningful pieces of large systems, shaping technical decisions, and expanding expertise in backend engineering and