Senior Platform Testing Engineer - Build AI Test Harnesses

Triwill Group; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Full medical/dental/vision coverage

Flexible PTO including Winter Break

Parental leave

Fertility and family-building stipend

401(k)

Equity

Exposure to ML startups

Job summary

Baseten in San Francisco, CA is seeking experienced Software Engineers to join the Platform team. You will own the end-to-end testing stack for AI inference workloads, building frameworks, harnesses, and feedback loops that raise the bar for what well-tested means at Baseten.

As a senior tester/engineer, you’ll design scalable test infrastructure, implement resilience and chaos testing, and mentor others to raise the entire org's testing standards.

Qualifications

• Strong proficiency in Go and/or Python, with hands-on experience building test tooling and libraries used by other engineers.
• Deep experience with testing frameworks and their internals — pytest, Go's testing package, testify, testcontainers, or equivalents — including the ability to extend them, not just use them.
• Experience designing integration test infrastructure for distributed systems, including empirical environment provisioning and dependency management.

Responsibilities

• Own Baseten's testing strategy end to end — define the standards, the tiers, and the tooling that engineering teams build against.
• Build and maintain unit, integration, load and performance testing frameworks
• Design end to end test infrastructure that provisions realistic dependencies on demand — ephemera Kubernetes namespaces, containerized service dependencies, etc.
• Build resilience and chaos testing capabilities: fault injection, network partition and latency simulation, pod and node failure scenarios, dependency degradation, and automated verification that our systems degrade gracefully and recover.
• Attack test suite reliability head-on — flake detection and quarantine, test impact analysis and selective execution, parallelization, and aggressive reduction of end-to-end CI wall time.
• Build observability into the testing layer itself: coverage reporting, test health dashboards, failure triage tooling, and clear signals about which areas of the codebase are under-tested.
• Create project templates and shared libraries so new services start with a complete testing setup on day one.
• Partner directly with product and infrastructure teams — embed where needed, understand their hardest testing problems, and turn one-off solutions into platform capabilities.
• Mentor engineers across the org on testing practice and raise the collective bar through code review, documentation, and internal advocacy.

Skills

Go

Python

Testing tooling

Tools

pytest

Testcontainers

K6

Locust

JMeter

Docker

Kubernetes

Job description

Baseten in San Francisco, CA is seeking experienced Software Engineers to join the Platform team. You will own the end-to-end testing stack for AI inference workloads, building frameworks, harnesses, and feedback loops that raise the bar for what well-tested means at Baseten.

As a senior tester/engineer, you’ll design scalable test infrastructure, implement resilience and chaos testing, and mentor others to raise the entire org's testing standards.