Senior Software Development Engineer in Test (Python)

Roku, Inc.; Hartford; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading streaming technology company in the United Kingdom is seeking an experienced engineer to enhance AI-driven automation systems. Responsibilities include developing solutions, monitoring systems, and collaborating with teams. The ideal candidate has over 5 years of experience with automation, strong Python skills, and a background in AI testing. Join us to make a significant impact in streaming technology.

Qualifications

• 5+ years of hands-on experience with automation systems.
• 3+ years of programming experience, preferably with Python.
• Ability to design and optimize solutions leveraging LLMs via API.
• Experience testing AI-powered features.
• 2+ years of experience developing test plans and cases.

Responsibilities

• Design, develop, and maintain AI-driven automation systems.
• Collaborate with teams to deliver AI-based solutions.
• Assist in monitoring and maintenance of critical systems.
• Debug failing tests to improve automated test quality.

Skills

Automation systems

Python scripting

LLMs usage

Debugging

Communication

AWS

Linux/Unix

Continuous integration tools

Education

Bachelor's degree in Computer Science or related field

Tools

LangChain

TensorFlow

Jenkins

Terraform

Kubernetes

Job description

With millions of users worldwide, our products have earned a reputation for "just working" seamlessly right out of the box, almost like magic. This seamless experience is no accident; it's a testament to our commitment to creating products that are not just intuitive but downright obvious. At the heart of this commitment is the Roku OS QA Team, dedicated to rigorously testing every product and feature to ensure we deliver the most reliable streaming media platform in the industry. Our mission is simple: help people effortlessly find and stream the content they love. We achieve this through cutting‑edge technology and engineering, always putting the customer at the center of everything we do.

What you'll be doing

• Design, develop, and maintain AI‑driven automation systems
• Collaborate with data scientists, software engineers, and product teams to understand and deliver AI‑based solutions
• Build new tools and technology
• Assist in monitoring and maintenance of critical systems
• Debug failing tests to improve the quality of automated test tools and frameworks
• Conduct code reviews to improve code quality and optimization
• Promote coding conventions and standards for code re‑usability and cleanliness

Qualifications

• 5+ years of hands‑on experience with automation systems
• 3+ years of programming experience, preferably with Python for scripting and working with machine learning tools
• Ability to design, implement, and optimize solutions leveraging LLMs via API
• Experience using various LLMs (OpenAI, Anthropic APIs) and AI frameworks such as LangChain, TensorFlow, etc.
• Hands‑on experience testing AI‑powered features (e.g., recommendation systems, computer vision models, chatbots)
• 2+ years of experience developing test plans and test cases
• Bachelor's degree in Computer Science or related field
• Expert‑level debugging skills
• Excellent verbal and written communication skills
• Experience working with remote teams
• Knowledge of continuous integration tools (Jenkins/Hudson, TeamCity, Maven, Gradle)
• Hands‑on experience and proficiency in Linux/Unix systems
• Hands‑on experience with AWS or equivalent cloud providers
• Ability to learn new technologies quickly
• Experience mentoring less‑experienced engineers and driving automation development
• A self‑directed professional able to work independently
• Previous experience with non‑functional testing (performance testing, stress testing)
• Experience with infrastructure as code and orchestration technologies (Terraform, Kubernetes, CloudFormation)
• Certifications or training in AI/ML or AI testing (e.g., Coursera AI for Everyone, Google AI Engineer, ISTQB AI Testing Foundation)

About Roku

Roku is changing how the world watches TV. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform that connects the entire TV ecosystem. We connect consumers to the content they love, enable content publishers to build and monetize large audiences, and provide advertisers unique capabilities to engage consumers.

From your first day at Roku, you'll make a valuable contribution. We’re a fast‑growing public company where no one is a bystander. We offer you the opportunity to delight millions of TV streamers around the world while gaining meaningful experience across a variety of disciplines.

Roku is a company that values diversity and encourages a culture of collaboration and innovation. We try to surround ourselves with people who are great at their jobs, who are easy to work with, and who keep their egos in check.

For more about our culture and benefits, please consult with your recruiter.