Senior Backend Engineer – AI Observability & Evals

Fdetimes; New York (NY); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k) plan

In-office meals in the US

Job summary

LangChain is seeking a Senior Backend Engineer to build and maintain the backend systems powering LangSmith’s observability and evaluation platform. You will work on core services enabling developers to monitor and evaluate AI applications at scale.

The role emphasizes backend feature development, with valuable exposure to full-stack, performance tuning, and debugging production issues. Ideal candidates have strong API design skills, experience with high-throughput data, and hands-on work with

Qualifications

• 5+ years of backend engineering experience on highly complex products.
• Proficiency in Python or Go.
• Strong understanding of API design and building reliable data services.
• Experience with high-throughput or mission-critical systems.
• Experience with Postgres, Redis, Clickhouse, and cloud platforms (AWS, GCP, Azure).

Responsibilities

• Design, develop, and maintain backend services and APIs to support tracing, monitoring, and evaluation workflows.
• Collaborate on architectural decisions for performance and maintainability.
• Optimize storage and query performance for high-volume observability and evaluation data.
• Ensure system reliability through testing, monitoring, and alerting practices.
• Troubleshoot production issues and perform root-cause analysis with long-term fixes.
• Create and maintain technical documentation, including system design and APIs.
• Work with full-stack engineers, product managers, and designers on rolling out new features.

Skills

Backend engineering

Python/Go

API design

High-throughput systems

Performance optimization

Databases

Cloud platforms

Communication

Ownership mentality

Job description

LangChain is seeking a Senior Backend Engineer to build and maintain the backend systems powering LangSmith’s observability and evaluation platform. You will work on core services enabling developers to monitor and evaluate AI applications at scale.

The role emphasizes backend feature development, with valuable exposure to full-stack, performance tuning, and debugging production issues. Ideal candidates have strong API design skills, experience with high-throughput data, and hands-on work with