Backend Platform Engineer – AI Inference & Observability

US Health Partners, LLC; San Francisco, New York, Seattle (CA, NY, WA); Hybrid; USD 180,000 - 260,000; Full time

Benefits offered by this job

Competitive compensation

100% medical, dental, vision for emp &

Flexible PTO including Winter Break

Paid parental leave

Fertility and family-building stipend

401(k)

Exposure to ML startups

Job summary

Baseten is hiring a backend/distributed systems engineer for our Product Platform. You will design and build scalable telemetry, observability, and billing systems, while owning internal AI agent platform and testing strategy end to end.

You’ll collaborate with infrastructure, model performance, and product teams to accelerate adoption and ship high-quality, maintainable systems. You will work on cross-team initiatives to improve reliability, reduce cost, and scale with company growth, with a

Qualifications

• Bachelor’s degree or equivalent experience in CS/engineering.
• 5+ years building scalable backend systems.
• Experience with observability (logging/metrics/tracing) at scale.
• Proficiency in Python, Go, or Rust.
• Strong systems-level thinking and platform mindset.
• Excellent written and verbal communication skills.

Responsibilities

• Design and build scalable telemetry ingest and storage pipelines for metrics, logs, and traces across Baseten’s multi-cloud infrastructure.
• Own and evolve core observability platforms, driving migrations and architectural improvements that improve reliability, reduce cost, and scale with organizational growth.
• Build world class commercialization and billing systems.
• Work on strategic partnership integrations.
• Develop internal infrastructure and tooling that improves developer velocity, CI/CD, and deployment safety.
• Own the internal AI agent platform end to end — architecture, build, rollout, operation, measurement.
• Own Baseten's testing strategy end to end — define the standards, the tiers, and the tooling that engineering teams build against.
• Drive adoption through developer experience — good defaults, clear docs, low friction.
• Improve platform reliability through better alerting, incident tooling, and production debugging workflows.
• Lead technical design for cross-team projects and tradeoffs between speed, quality, maintainability.
• Partner with infrastructure, model performance, and product teams to ship faster.
• Raise the engineering bar through code review and mentorship.

Skills

Backend systems

Observability

Python

Go/Rust

Distributed systems

Education

Bachelor’s degree in CS/Engineering

Job description

Baseten is hiring a backend/distributed systems engineer for our Product Platform. You will design and build scalable telemetry, observability, and billing systems, while owning internal AI agent platform and testing strategy end to end.

You’ll collaborate with infrastructure, model performance, and product teams to accelerate adoption and ship high-quality, maintainable systems. You will work on cross-team initiatives to improve reliability, reduce cost, and scale with company growth, with a