Platform Backend Engineer – Observability & AI Infra

Baseten; United States; Remote; USD 150,000 - 230,000; Full time

Job summary

Baseten is hiring a backend/distributed systems engineer to join our Product Platform. You will design and implement scalable telemetry, observability, billing, and deployment tooling to support multi-cloud production workloads.

You will own the internal AI agent platform, testing strategy, and cross-team architectural decisions, collaborating with infrastructure, model performance, and product teams to ship reliable, cost-efficient solutions.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience.
• 5+ years of relevant industry experience with scalable backend systems.
• Experience building or operating observability systems (logging, metrics, tracing) or internal infrastructure at scale.
• Proficiency in Python, Go, Rust, or similar backend languages.
• Strong focus on quality and engineering discipline.

Responsibilities

• Design and build scalable telemetry ingest and storage pipelines for metrics, logs, and traces across Baseten’s multi-cloud infrastructure
• Own and evolve core observability platforms, driving migrations and architectural improvements that improve reliability, reduce cost, and scale with organizational growth
• Build world class commercialization and billing systems
• Work on partnerships integrations
• Develop internal infrastructure and tooling that improves developer velocity, CI/CD, and deployment safety
• Own the internal AI agent platform end to end — architecture, build, rollout, operation, measurement
• Own Baseten's testing strategy end to end — define the standards, the tiers, and the tooling that engineering teams build against
• Drive adoption through developer experience — good defaults, clear docs, low friction — not mandate
• Improve platform reliability through better alerting, incident tooling, and production debugging workflows
• Lead technical design for cross-team projects and make sound tradeoffs between speed, quality, and long-term maintainability
• Partner with infrastructure, model performance, and product teams to understand what they need to see and ship faster
• Raise the engineering bar through code review, mentorship, and clear technical writing

Skills

Backend systems

Observability

Python

Go

Rust

Distributed systems

Education

Bachelor's degree in Computer Science or related

Job description

Baseten is hiring a backend/distributed systems engineer to join our Product Platform. You will design and implement scalable telemetry, observability, billing, and deployment tooling to support multi-cloud production workloads.

You will own the internal AI agent platform, testing strategy, and cross-team architectural decisions, collaborating with infrastructure, model performance, and product teams to ship reliable, cost-efficient solutions.