Senior AI Automation Test Engineer

Roku; United States; Hybrid; USD 141,000 - 361,000; Full time

Benefits offered by this job

Health insurance

Equity awards

Life insurance

Disability benefits

Parental leave

Wellness benefits

Paid time off

Job summary

Roku is seeking a hands-on Senior Software Engineer in Test (Sr SDET) to join our Browse and Discovery Team. You will own quality for APIs and data pipelines, building automated test frameworks, containerized checks, and IaC-driven CI/CD workflows.

You'll work with agentic AI to drive integration tests, triage failures, and debug production issues, designing scalable testing ecosystems and reusable patterns across Roku teams.

Qualifications

• 5+ years of experience in software testing and automation, software engineering, or adjacent domains.
• Strong software engineering fundamentals and ability to build production-grade systems.
• Experience with CI/CD tooling and cloud platforms (AWS/GCP/Azure).
• Hands-on experience with LLM-based systems, prompt design, and agent orchestration.

Responsibilities

• Design and develop automated test frameworks for APIs and data pipelines.
• Containerize automated quality checks for complex services.
• Author and maintain integration tests; keep test suites healthy and triage failures.
• Build context and retrieval pipelines to ground agents in code, schemas, telemetry, and business logic.
• Implement tool-calling and MCP-style integrations for test runners, CI, logs and data services.
• Build and maintain CI/CD workflows and infrastructure as code (Terraform or CloudFormation).
• Establish observability and monitoring for test reliability, latency, and cost.
• Create reusable templates and paved-path patterns and collaborate with teams to improve end-to-end testing.

Skills

Python/Java

LLM-based systems

CI/CD tooling

Cloud platforms

Terraform/CloudFormation

Linux Bash

Kubernetes

Agent frameworks

Test automation

Education

Bachelor's or master's degree in CS/Engineering

Tools

GitHub Actions

GitLab runners

Jenkins

Travis CI

Terraform

CloudFormation

Docker

Kubernetes

Job description

Roku is seeking a hands-on Senior Software Engineer in Test (Sr SDET) to join our Browse and Discovery Team. You will own quality for APIs and data pipelines, building automated test frameworks, containerized checks, and IaC-driven CI/CD workflows.

You'll work with agentic AI to drive integration tests, triage failures, and debug production issues, designing scalable testing ecosystems and reusable patterns across Roku teams.