Software Engineer in Test, Python

Roku; Cambridge (MA); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Health insurance

Mental health support

Retirement options

Job summary

Roku is seeking a Software Engineer (SDET) to advance our AI-enabled testing strategy. You’ll collaborate with software and QA engineers to design intelligent analysis systems that identify quality gaps and predict failures, using AI and analytics to raise the bar on test effectiveness.

The role emphasizes scalable testing, production reliability, and strong collaboration across teams. Ideal candidates have 4+ years in test architecture, 3+ years Python, familiarity with CI tools, and knowledge

Qualifications

• 4+ years of hands-on experience with test architecture and automation systems design.

Responsibilities

• Design and implement intelligent test analysis systems that identify quality gaps, predict failure patterns, and optimize test effectiveness.
• Design systems that collect, analyse and act on the testing data to continuously improve on the quality processes.
• Experience with systematic regression tracking and implementing process to prevent regression reoccurrence.
• Establish new methodologies for measuring and improving test quality beyond simple pass/fail metrics, focusing on regression prevention and production reliability.
• Leverage AI-powered tools for automated failure analysis, root cause identification, and test flakiness scoring.
• Define and implement architectural patterns that make testing more effective, maintainable, and aligned with business impact.

Skills

AI for testing

Autonomous testing agents

Test architecture

Python

CI tools

Test analysis

Communication

C++ basics

AI/ML training

AI testing certifications

Tools

Jenkins

GitLab

TeamCity

AWS

Job description

Teamwork makes the stream work.

Roku is changing how the world watches TV

Roku is the #1 TV streaming platform in the U.S., Canada, and Mexico, and we've set our sights on powering every television in the world. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform that connects the entire TV ecosystem. We connect consumers to the content they love, enable content publishers to build and monetize large audiences, and provide advertisers unique capabilities to engage consumers.

From your first day at Roku, you'll make a valuable - and valued - contribution. We're a fast-growing public company where no one is a bystander. We offer you the opportunity to delight millions of TV streamers around the world while gaining meaningful experience across a variety of disciplines.

What does the team work on?

With millions of users worldwide, our products have earned a reputation for "just working" seamlessly right out of the box, almost like magic. This seamless experience is no accident; it's a testament to our commitment to creating products that are not just intuitive but downright obvious. At the heart of this commitment is the Roku OS QA Team, dedicated to rigorously testing every product and feature to ensure we deliver the most reliable streaming media platform in the industry.

Our mission is simple: help people effortlessly find and stream the content they love. We achieve this through cutting‑edge technology and engineering, always putting the customer at the center of everything we do.

What is the role?

As part of our team, you'll leverage your diverse skills to support both Software Engineers and QA Engineers, tackling the daily challenges of their roles. Your specialist knowledge will be invaluable in suggesting improvements to enhance quality and streamline workflows, ensuring we continue to exceed our customers' expectations.

As a Software Engineer (SDET), you'll be the transformational force that revolutionizes our testing approach. You'll leverage AI and advanced analytics to identify quality gaps, architect intelligent testing solutions, and establish new standards for test effectiveness that go beyond simple coverage metrics.

How will I use AI at Roku?

At Roku, we don’t just use AI, we work with it. AI agents and smart tools help power drafts, analysis, and repetitive workflows, while our people bring direction, judgment, and accountability. We’re looking for curious, adaptable builders who can show how they’ve used AI or automation to move faster, raise the bar, and scale their impact.
We value your AI skills if have built fluency across the agentic engineering toolchain — coding harnesses like Claude Code or Cursor, MCP servers, custom skills, or agent frameworks. And you can describe projects where you shipped real work with these tools. You know how to drive an agent, verify its output, and ramp on an unfamiliar codebase with an agent helping you.

What are the responsibilities of the role?

• Design and implement intelligent test analysis systems that identify quality gaps, predict failure patterns, and optimize test effectiveness
• Design systems that collect, analyse and act on the testing data to continuously improve on the quality processes
• Experience with systematic regression tracking and implementing process to prevent regression reoccurrence
• Establish new methodologies for measuring and improving test quality beyond simple pass/fail metrics, focusing on regression prevention and production reliability
• Leverage AI-powered tools for automated failure analysis, root cause identification, and test flakiness scoring
• Define and implement architectural patterns that make testing more effective, maintainable, and aligned with business impact

What experience would help someone be successful in this role at Roku?

• AI expertise for testing: Ability to design, implement, and optimize solutions leveraging LLMs, agentic AI systems, and predictive analytics for quality assurance
• Experience with autonomous testing agents capable of independently discovering, executing, and adapting test strategies.
• 4+ years of hands‑on experience with test architecture and automation systems design
• 3+ years of programming experience across multiple languages with Python
• AI expertise for testing: Ability to design, implement, and optimize solutions leveraging LLMs, and predictive analytics for quality assurance
• Knowledge of continuous integration tools (Jenkins/GitLab, TeamCity, AWS) and their optimization for quality gates
• Advanced test analysis skills: Experience with test flakiness analysis, failure pattern recognition, and automated root cause identification
• Excellent verbal and written communication skills
• Some working knowledge of C++
• Certifications or training in AI/MLor AI testing (e.g., Coursera AI for Everyone, Google AI Engineer, ISTQB AI Testing Foundation)

#LI-AB3

What's Roku's approach to hybrid working?

Roku fosters an inclusive and collaborative environment where teams generally work in the office Monday through Thursday. Fridays are generally flexible for remote work, except for employees whose specific roles or assigned office location require five days' a week attendance.

What are some of the benefits?

Roku is committed to offering a diverse range of benefits as part of our compensation package to support our employees and their families. Our comprehensive benefits include global access to mental health and financial wellness support and resources. Local benefits include statutory and voluntary benefits which may include healthcare (medical, dental, and vision), life, accident, disability, commuter, and retirement options (401(k)/pension). Employees are supported in taking time off, in accordance with local leave policies and other personal needs to support their evolving work and life needs. It's important to note that not every benefit is available in all locations or for every role. For details specific to your location, please consult with your recruiter.

Accommodations

Roku welcomes applicants of all backgrounds and provides reasonable accommodations and adjustments in accordance with applicable law. If you require reasonable accommodation at any point in the hiring process, please direct your inquiries to [e-mail].

What should I know about Roku's culture?

Roku is a great place for people who want to work in a fast‑paced environment where everyone is focused on the company's success rather than their own. We try to surround ourselves with people who are great at their jobs, who are easy to work with, and who keep their egos in check. We appreciate a sense of humor. We believe a fewer number of very talented folks can do more for less cost than a larger number of less talented teams. We're independent thinkers with big ideas who act boldly, move fast and accomplish extraordinary things through collaboration and trust. In short, at Roku you'll be part of a company that’s changing how the world watches TV.

We have a unique culture that we are proud of. We think of ourselves primarily as problem‑solvers, which itself is a two‑part idea. We come up with the solution, but the solution isn't real until it is built and delivered to the customer. That penchant for action gives us a pragmatic approach to innovation, one that has served us well since 2002.

To learn more about Roku, our global footprint and how we've grown, visit https://www.weareroku.com/factsheet.

By providing your information, you acknowledge that you want Roku to contact you about job roles, that you have read Roku's Applicant Privacy Notice, and understand that Roku will use your information as described in that notice. If you do not wish to receive any communications from Roku regarding this role or similar roles in the future, you may unsubscribe at any time by emailing [e-mail].