Senior ML SDET: Test Automation & Model Validation

Sony Playstation; Madison (WI); On-site; USD 152,000 - 190,000; Full time

Job summary

Sony Interactive Entertainment in Madison, WI is seeking a Sr Software Development Engineer in Test, ML to lead quality efforts for machine learning-powered products and services. You will partner with ML engineers, software engineers, product managers, and data partners to build scalable test automation for systems at global scale.

This role focuses on validating probabilistic models through score distributions and cohort-level behavior, not just deterministic pass/fail, requiring strong

Qualifications

• Bachelor's degree in Computer Science or related field.
• 5+ years as an SDET, testing backend systems.
• Proficiency in Python/Java/Scala/go for test automation.
• Hands-on experience with API testing tools (e.g., Postman) for distributed systems.
• Familiarity with CI/CD pipelines and test execution in Jenkins or similar (GitHub Actions, ArgoCD).
• Hands-on experience building automated test frameworks (pytest, JUnit, TestNG).
• Experience with databases for backend validation.
• Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker).
• Familiarity with monitoring/observability tools (Prometheus, Grafana, Databricks).
• Strong understanding of SDLC and Agile methodologies.
• Excellent problem-solving and communication skills.

Responsibilities

• Drive architecture-level automation solutions across teams.
• Design, develop, and maintain automated test frameworks and scripts for ML inference services.
• Create realistic test accounts and datasets to evaluate model behavior.
• Validate model score distributions, ranking, and output quality.
• Perform functional, integration, regression, API, and non-functional testing.
• Collaborate with ML engineers and ops to ensure automated coverage in CI/CD.
• Debug and analyze test failures and report defects.
• Promote high standards of quality and scalable test strategies.
• Develop best practices for scalable test automation.
• Monitor test execution and optimize test environment performance.
• Propose innovative solutions to organizational problems.

Skills

Python

Java

Scala

Go

Test automation

CI/CD

API testing

Jenkins

GitHub Actions

ArgoCD

pytest

JUnit

TestNG

Databases

AWS

GCP

Kubernetes

Docker

Prometheus

Grafana

SDLC

Agile

Education

Bachelor's degree in Computer Science or related field

Tools

Postman

pytest

JUnit

TestNG

Jenkins

GitHub Actions

ArgoCD

AWS

GCP

Kubernetes

Docker

Prometheus

Grafana

Job description

Sony Interactive Entertainment in Madison, WI is seeking a Sr Software Development Engineer in Test, ML to lead quality efforts for machine learning-powered products and services. You will partner with ML engineers, software engineers, product managers, and data partners to build scalable test automation for systems at global scale.

This role focuses on validating probabilistic models through score distributions and cohort-level behavior, not just deterministic pass/fail, requiring strong