Senior Backend Engineer, AI Observability & Evals Platform

LangChain, Inc.; New York (NY); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Competitive compensation

Equity

Benefits

Job summary

LangChain, Inc. is seeking a Senior Backend Engineer to build the backend systems powering LangSmith’s observability and evals platform.

You will develop core services and APIs to monitor and evaluate AI applications at scale, with a focus on backend feature development and performance tuning. Ideal candidates have 5+ years in backend engineering, strong Python or Go, solid API design, and experience with high-throughput systems and cloud platforms (AWS, GCP, Azure).

Qualifications

• 5+ years of backend engineering experience on complex products.
• Proficiency in Python or Go and API design expertise.
• Experience with high-throughput systems and reliable data services.
• Strong collaboration and communication across teams.

Responsibilities

• Design, develop, and maintain backend services and APIs for tracing, monitoring, and evaluation workflows.
• Collaborate on architecture for performance and maintainability.
• Optimize storage and query performance for large observability data.
• Ensure reliability through testing, monitoring, and alerting.
• Troubleshoot production issues and perform root-cause analysis.
• Create and maintain technical docs and API references.
• Work with frontend, product managers, and designers to roll out new features.

Skills

Backend engineering

Python

Go

API design

Performance optimization

Tools

PostgreSQL

Redis

ClickHouse

AWS

GCP

Azure

Job description

LangChain, Inc. is seeking a Senior Backend Engineer to build the backend systems powering LangSmith’s observability and evals platform.

You will develop core services and APIs to monitor and evaluate AI applications at scale, with a focus on backend feature development and performance tuning. Ideal candidates have 5+ years in backend engineering, strong Python or Go, solid API design, and experience with high-throughput systems and cloud platforms (AWS, GCP, Azure).