Senior Software Development Engineer in Test, ML

Sony

Southwestern Ontario

Hybride

CAD 114 000 - 143 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

Sony Interactive Entertainment is seeking a Sr SDET for ML-focused testing in our Ontario, Canada location. You will champion automated testing across ML inference services, build scalable test frameworks, and validate model behavior before release. Collaboration with ML engineers and product teams drives quality at scale.

You will design data-driven test scenarios, ensure robust CI/CD integration, and strengthen testing across backend systems and APIs in a hybrid work setting.

Qualifications

  • Bachelor's degree in CS or related field.
  • 5+ years as SDET, with strong backend testing experience.
  • Proficiency in Python/Java/Scala/Go for test automation.
  • Hands-on API testing with distributed systems and CI/CD.

Responsabilités

  • Drive architecture-level automation solutions across teams.
  • Design, develop, and maintain automated test frameworks for ML and backend services.
  • Create realistic test datasets and account scenarios for model evaluation.
  • Validate score distributions and model signals prior to release.
  • Perform functional, integration, regression, and API testing.
  • Collaborate with ML engineers and ops to ensure automated coverage.

Connaissances

Python
Java
Scala
Go
API testing
CI/CD
Jenkins
Test automation
Docker
Kubernetes
Postman
Monitoring tools

Formation

Bachelor's degree in Computer Science or related field

Outils

pytest
JUnit
TestNG
Postman
AWS
GCP
Kubernetes
Docker

Description du poste

Why Sony Interactive Entertainment?

Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting‑edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. At PlayStation, we're passionate about both partnership and technology. We care about building performant products and powerful tools, solving practical problems in delightful ways. We love building the systems that millions of people use, and we're always our own first customers and critics. We strive to be at the forefront of development technologies and celebrate our diversity with engineering teams located on four continents from all walks of life.

Locations

Madison, WI and Waterloo, Ontario Canada

Sr Software Development Engineer in Test , ML

PlayStation is seeking a Sr Software Development Engineer in Test, ML to join our Madison team and lead quality efforts for machine learning‑powered products and services. You will partner closely with ML engineers, software engineers, product managers, and data partners to build scalable test automation and validation approaches for systems serving PlayStation at global scale. This role is focused on building confidence in model reliability, production readiness, and behavioral consistency. Unlike traditional software backend testing, success here requires validating probabilistic systems through score distributions, cohort‑level behavior, thresholds, and statistical signals, not just deterministic pass/fail assertions.

Responsibilities
  • Drive architecture‑level automation solutions and scalable quality engineering practices across multiple teams and product areas.
  • Design, develop, and maintain automated test frameworks, test scripts for ML inference services and related ML platform components using python/Java.
  • Build and automate realistic, representative test account creations and datasets to evaluate model behavior across different scenarios.
  • Validate score distributions, ranking behavior, output quality, and other model signals for incoming ML models prior to release.
  • Perform different types of testing, including functional, integration, regression, and API testing working with RESTful APIs, microservices and databases, and non‑functional performance and load testing to verify inference service scalability, latency requirements and reliability under production like conditions.
  • Work closely with ML engineers and ops teams to ensure that all features and bug fixes come with automated test coverage, ensuring continuous integration and deployment.
  • Debug and analyze test failures, model anomalies and report defects.
  • Drive high standards of quality for both engineering decisions and customer‑facing features with optimal test and automation strategy.
  • Develop and implement best practices for test automation that is highly scalable and maintainable.
  • Monitor test execution and optimize performance in test environments.
  • Come up with innovative solutions to organizational problems.
Required Qualifications
  • A Bachelor's degree in Computer Science or related field.
  • Minimum 5 years of experience as an SDET, with strong experience testing backend systems.
  • Proficiency in Python/Java/Scala/go for test automation.
  • Hands‑on experience with API testing tools (e.g., Postman or similar) for distributed systems.
  • Familiarity with CI/CD pipelines and test execution in Jenkins or similar environments such as jenkins, GitHub Actions, ArgoCD, etc.
  • Hands‑on experience building and maintaining automated test frameworks (e.g., pytest, JUnit, TestNG, etc.).
  • Experience in working with databases for backend validation.
  • Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker, etc.).
  • Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, etc.) for validating service health.
  • Strong understanding of software development lifecycle (SDLC) and agile methodologies.
  • Excellent problem‑solving skills and excellent communication skills.
Preferred Qualifications
  • Experience testing machine learning systems, such as recommendation systems, search ranking systems, or other probabilistic ML application systems.
  • Experience creating synthetic or seeded test data to simulate realistic customer/account behaviors.
  • Experience evaluating model outputs using statistical techniques, distribution analysis, or scenario‑based validation, rather than deterministic assertions.
  • Knowledge of data pipelines, feature stores, inference systems or model‑serving infrastructure (Seldon, KServe, Ray Serve, etc.) is a plus.
  • Experience with performance and load testing tools.
  • Experience with Databricks or similar ML platform tooling.
  • Experience architecting and optimizing CI/CD pipelines, quality gates, and release validation systems using Jenkins or similar platforms.
Base Pay Range

The estimated Ontario base pay range for this role is listed below.

$114,000 - $143,000 CAD

Please note that the base pay range may vary in line with our hybrid working policy and individual base pay will be determined based on job-related factors which may include knowledge, skills, experience, and location.

Please note, Sony Interactive Entertainment conducts background checks at the offer stage for all

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior Software Development Engineer in Test, ML
Senior Software Development Engineer in Test, ML

Sony Interactive Entertainment • Southwestern Ontario

Sur place
CAD 114 000 - 143 000
Senior Software Development Engineer in Test, ML Canada, Waterloo, ON
Senior Software Development Engineer in Test, ML Canada, Waterloo, ON

PlayStation • Southwestern Ontario

Hybride
CAD 114 000 - 143 000
Senior Software Development Engineer in Test, ML
Senior Software Development Engineer in Test, ML

Sony Interactive Entertainment (SIE) • Southwestern Ontario

Sur place
CAD 114 000 - 143 000
Copy of Senior Software Development Engineer in Test, ML
Copy of Senior Software Development Engineer in Test, ML

PlayStation Global • Southwestern Ontario

Sur place
CAD 114 000 - 143 000
Copy of Senior Software Development Engineer in Test, ML
Copy of Senior Software Development Engineer in Test, ML

sonyinteractiveentertainmentglobal • Waterloo

Hybride
CAD 100 000 - 140 000
Sr. Software Development Engineer in Test, AI/ML
Sr. Software Development Engineer in Test, AI/ML

Sony Interactive Entertainment Inc. (Japan) • Southwestern Ontario

Sur place
CAD 115 000 - 172 000
Medical, dental, vision coverage
401(k) matching
Paid time off
+2
Sr. Software Development Engineer in Test, AI/ML
Sr. Software Development Engineer in Test, AI/ML

playstation • Southwestern Ontario

Hybride
CAD 115 000 - 172 000
Medical benefits
Dental benefits
Vision benefits
+4
Sr. Software Development Engineer in Test, AI/ML
Sr. Software Development Engineer in Test, AI/ML

Sony Interactive Entertainment • Southwestern Ontario

Sur place
CAD 115 000 - 172 000
Copy of Senior Software Development Engineer in Test, ML Playstation Canada, Waterloo, ON Engineering Software Canada, Waterloo, ON
Copy of Senior Software Development Engineer in Test, ML Playstation Canada, Waterloo, ON Engineering Software Canada, Waterloo, ON

SportsTechJobs • Southwestern Ontario

Sur place
CAD 114 000 - 143 000
Sr. Software Development Engineer in Test, AI/ML
Sr. Software Development Engineer in Test, AI/ML

Sony Playstation • Southwestern Ontario

Hybride
CAD 115 000 - 172 000
Medical benefits
Dental benefits
Vision benefits
+4