Senior Backend Engineer for Scalable AI Observability

langchain; New York (NY); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

401(k) plan

Meals on in-office days

Job summary

LangChain is seeking a Senior Backend Engineer to build and maintain the LangSmith observability and evals platform. You will own core backend services, APIs, and data pipelines to enable developers to monitor and evaluate AI applications at scale.

In this role, you will collaborate with product, design, and frontend teams, optimize performance, and ensure reliability through testing and monitoring. Experience with Python or Go and cloud platforms is essential.

Qualifications

• 5+ years of backend engineering experience on highly complex products.
• Proficiency in Python or Go.
• Strong API design and reliable data services understanding.
• Experience with high-throughput or mission-critical systems.
• Ability to optimize backend services for performance and reliability.
• Experience with PostgreSQL, Redis, ClickHouse; cloud platforms AWS, GCP, Azure.

Responsibilities

• Design, develop, and maintain backend services and APIs to support LangSmith's tracing, monitoring, and evaluation workflows.
• Collaborate on architectural decisions to ensure systems are performant and maintainable.
• Optimize storage and query performance for high-volume observability and evaluation data.
• Ensure system reliability through strong testing, monitoring, and alerting practices.
• Troubleshoot and resolve production issues, performing root-cause analysis and implementing long-term fixes.
• Create and maintain technical documentation, including system design and API references.
• Work closely with full-stack engineers, product managers, and product designers on rolling out new features.

Skills

Backend engineering

Python

Go

API design

High-throughput systems

Performance optimization

Communication

Customer focus

Cloud platforms

PostgreSQL

Redis

ClickHouse

AWS

GCP

Azure

Job description

LangChain is seeking a Senior Backend Engineer to build and maintain the LangSmith observability and evals platform. You will own core backend services, APIs, and data pipelines to enable developers to monitor and evaluate AI applications at scale.

In this role, you will collaborate with product, design, and frontend teams, optimize performance, and ensure reliability through testing and monitoring. Experience with Python or Go and cloud platforms is essential.