Senior Backend Engineer — AI Observability & Evals

Applied Methods Ltd; New York (NY); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) plan

In-office meals in the US

Job summary

LangChain is seeking a Senior Backend Engineer to build and maintain the backend systems powering LangSmith’s observability, evaluation, and production reliability workflows. You will focus on core services that monitor and evaluate AI applications at scale, collaborating with frontend, product managers, and designers.

The role requires 5+ years of backend experience, strong Python or Go skills, API design expertise, and experience with high-throughput systems, databases, and cloud platforms.

Qualifications

• 5+ years of backend development experience in complex products.
• Proficiency in Python or Go and API design for reliable data services.
• Experience with high-throughput or mission-critical systems.
• Ability to optimize backend services for performance and reliability.
• Experience with databases (PostgreSQL, Redis, ClickHouse) and cloud platforms (AWS, GCP, Azure).

Responsibilities

• Design, develop, and maintain backend services and APIs for LangSmith tracing, monitoring, and evaluation workflows.
• Collaborate on architectural decisions for performance and maintainability.
• Optimize storage and query performance for high-volume data.
• Ensure reliability through testing, monitoring, and alerting.
• Troubleshoot production issues and perform root-cause analysis.
• Create system design and API documentation; assist cross-functional teams with feature rollouts.

Skills

Python

Go

API design

Performance

Observability

Tools

PostgreSQL

Redis

ClickHouse

AWS

GCP

Azure

Job description

LangChain is seeking a Senior Backend Engineer to build and maintain the backend systems powering LangSmith’s observability, evaluation, and production reliability workflows. You will focus on core services that monitor and evaluate AI applications at scale, collaborating with frontend, product managers, and designers.

The role requires 5+ years of backend experience, strong Python or Go skills, API design expertise, and experience with high-throughput systems, databases, and cloud platforms.