Senior Backend Engineer, AI Observability & Evals (Equity)

Engg; New York, Northern (NY, KY); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) plan

In-office meals

Job summary

LangChain is seeking a Senior Backend Software Engineer for its AI Observability & Evals Platform in New York City. You will design and maintain backend services powering LangSmith’s observability and evaluation workflows, and collaborate across product and engineering teams.

The role emphasizes reliable, high-throughput systems, with a strong focus on API design, performance, and scalable data services. Join a fast-growing team building production-grade AI tooling.

Qualifications

• 5+ years of backend engineering on complex products.
• Proficiency in Python or Go.
• Strong API design and data services experience.
• Experience with high-throughput or mission-critical systems.
• Experience with Postgres, Redis, and ClickHouse.
• Experience with AWS, GCP, or Azure.
• Excellent cross-functional communication.

Responsibilities

• Design, develop, and maintain backend services and APIs for LangSmith’s observability and evals workflows.
• Collaborate on architectural decisions for performance and maintainability.
• Optimize storage and query performance for high-volume data.
• Ensure reliability with testing, monitoring, and alerting.
• Troubleshoot production issues and perform root-cause analysis.
• Create technical documentation including system designs and API references.
• Collaborate with full-stack, product managers, and designers on feature rollouts.

Skills

Backend development

Python

Go

API design

Performance optimization

Observability

Tools

Postgres

Redis

ClickHouse

AWS

GCP

Azure

Job description

LangChain is seeking a Senior Backend Software Engineer for its AI Observability & Evals Platform in New York City. You will design and maintain backend services powering LangSmith’s observability and evaluation workflows, and collaborate across product and engineering teams.

The role emphasizes reliable, high-throughput systems, with a strong focus on API design, performance, and scalable data services. Join a fast-growing team building production-grade AI tooling.