Senior AI Automation Engineer - Testing & QA

Roku, Inc.; San Jose (CA); Hybrid; USD 141,000 - 361,000; Full time

Benefits offered by this job

Health insurance

Equity awards

Life insurance

Disability benefits

Parental leave

Wellness benefits

Paid time off

Job summary

Roku, Inc. is seeking a hands-on Senior Software Engineer in Test to own QA for APIs and data pipelines on the Browse and Discovery Team. You will drive automated testing, containerized quality checks, and CI/CD workflows that enable safe ship‑it capabilities across the org.

You will leverage agentic AI tooling and design robust retrieval pipelines to ground tests in real code, data schemas, and telemetry. This role emphasizes reliability, scalability, and reusable testing components for

Qualifications

• 5+ years of software testing and automation experience.
• Proficiency in Python or Java; familiarity with the other language.
• Experience designing test plans and automated test frameworks for APIs, services, and data pipelines.
• Hands-on experience with LLM-based systems and agent orchestration patterns.
• Experience building and maintaining retrieval and context pipelines, agent frameworks, and MCP servers or equivalent function‑calling architectures.
• Experience with CI/CD tooling such as GitLab runners, GitHub Actions, Jenkins, or Travis CI.
• Experience with cloud platforms (AWS/GCP/Azure) and containerization (Docker, Kubernetes).
• Bachelor's or master's degree in CS/CE/EE or related field or equivalent experience.

Responsibilities

• Design and develop automated test frameworks for APIs and data pipelines.
• Containerize automated quality checks for complex services.
• Use agentic AI workflows for tests and triage failures.
• Build context and retrieval pipelines to ground agents in code and data.
• Implement tool‑calling and MCP‑style integrations for test runners and logs.
• Build and maintain CI/CD workflows and infrastructure as code.
• Establish observability and monitoring for test reliability and metrics.

Skills

Python

Java

Test automation

CI/CD

Linux

AI in testing

Education

Bachelor's or Master's in CS/CE/EE or related

Tools

Docker

Kubernetes

Terraform

GitHub Actions

Job description

Roku, Inc. is seeking a hands-on Senior Software Engineer in Test to own QA for APIs and data pipelines on the Browse and Discovery Team. You will drive automated testing, containerized quality checks, and CI/CD workflows that enable safe ship‑it capabilities across the org.

You will leverage agentic AI tooling and design robust retrieval pipelines to ground tests in real code, data schemas, and telemetry. This role emphasizes reliability, scalability, and reusable testing components for