Senior Backend Engineer - AI Observability & Evals Platform

LangChain; New York (NY); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) plan

Meals on in-office days (US)

Flexible vacation

Job summary

LangChain is seeking a Senior Backend Engineer to build and maintain backend systems powering LangSmith’s observability and evaluation platform. You will work on core services enabling developers to monitor and evaluate AI applications at scale, with emphasis on backend functionality and potential frontend collaboration.

The role requires deep experience in backend engineering, API design, and high-throughput systems, with familiarity across Postgres, Redis, ClickHouse and cloud platforms like

Qualifications

• 5+ years of backend engineering experience on complex products.
• Proficiency in Python or Go.
• Strong API design and reliable data services.
• Experience with high-throughput systems.
• Ability to optimize backend reliability and performance.
• Experience with Postgres, Redis, ClickHouse and cloud platforms (AWS, GCP, Azure).

Responsibilities

• Design, develop, and maintain backend services and APIs for LangSmith’s tracing, monitoring, and evaluation workflows.
• Collaborate on architectural decisions to ensure systems are performant and maintainable.
• Optimize storage and query performance for high-volume observability and evaluation data.
• Ensure system reliability through strong testing, monitoring, and alerting practices.
• Troubleshoot and resolve production issues, performing root-cause analysis and implementing long-term fixes.
• Create and maintain technical documentation, including system design and API references.
• Work closely with full-stack engineers, product managers, and product designers on rolling out new features.

Skills

Backend engineering

Python

Go

API design

Performance optimization

Distributed systems

Communication

Customer focus

Tools

PostgreSQL

Redis

ClickHouse

AWS

GCP

Azure

Job description

LangChain is seeking a Senior Backend Engineer to build and maintain backend systems powering LangSmith’s observability and evaluation platform. You will work on core services enabling developers to monitor and evaluate AI applications at scale, with emphasis on backend functionality and potential frontend collaboration.

The role requires deep experience in backend engineering, API design, and high-throughput systems, with familiarity across Postgres, Redis, ClickHouse and cloud platforms like