Senior Backend Engineer - Real-Time AI Platform

Braintrust; San Francisco (CA); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Daily lunch, snacks, and beverages

Flexible time off

Competitive salary and equity

Wifi & cellphone stipend

Job summary

Braintrust is building the infra behind AI development tools, delivering real-time data pipelines and scalable layers that unify calls to OpenAI, Anthropic, Gemini and more. The role emphasizes observability, reliability, and speed, with collaboration across product teams to ship impactful features.

You’ll own core platform components, contribute to open source libraries, and help scale ingestion pipelines while supporting enterprise-grade access controls and data retention policies.

Qualifications

• 5+ years of backend engineering experience across multiple parts of the stack
• Strong systems thinking with experience designing for scale, uptime, and data integrity
• Proficiency in modern backend tech (Node.js, Go, Python, Rust, Postgres, Redis, Terraform, Docker, AWS)

Responsibilities

• Design and ship features to give users insight into LLM usage and performance
• Build a unifying layer proxies, caches, and normalizes calls across providers
• Develop open source libraries for tracing and evaluating LLM calls in customer apps
• Build real-time data pipelines to ingest, store, and query AI usage data
• Collaborate with product engineers to ship end-to-end features solving real customer problems

Skills

Backend engineering

Systems thinking

Node.js

Go

Python

Rust

Postgres

Redis

Terraform

Docker

AWS

Observability tooling

Ambiguity handling

Communication

Tools

Grafana

Prometheus

Datadog

Job description

Braintrust is building the infra behind AI development tools, delivering real-time data pipelines and scalable layers that unify calls to OpenAI, Anthropic, Gemini and more. The role emphasizes observability, reliability, and speed, with collaboration across product teams to ship impactful features.

You’ll own core platform components, contribute to open source libraries, and help scale ingestion pipelines while supporting enterprise-grade access controls and data retention policies.