Senior ML Testing & Automation Engineer (SDET)

Sony; Madison (WI); On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical, dental, vision benefits

401(k) matching

Paid time off

Wellness program

Employee discounts

Job summary

Sony Interactive Entertainment in the United States is seeking a Senior Software Development Engineer in Test, ML to join the Madison team and lead quality efforts for machine learning-powered products and services.

You will partner with ML engineers, software engineers, product managers, and data partners to build scalable test automation and validation approaches for systems serving PlayStation at global scale.

Qualifications

• Bachelor's degree in Computer Science or related field.
• Minimum 5 years of experience as an SDET, with strong experience testing backend systems.
• Proficiency in Python/Java/Scala/Go for test automation.
• Hands-on experience with API testing tools (e.g., Postman) for distributed systems.
• Familiarity with CI/CD pipelines and test execution in Jenkins or similar environments.
• Hands-on experience building and maintaining automated test frameworks (pytest, JUnit, TestNG).
• Experience in working with databases for backend validation.
• Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker).
• Familiarity with monitoring and observability tools (Prometheus, Grafana, Datadog).
• Strong understanding of SDLC and agile methodologies.
• Excellent problem-solving and communication skills.

Responsibilities

• Drive architecture-level automation solutions and scalable quality engineering practices across multiple teams and product areas.
• Design, develop, and maintain automated test frameworks and scripts for ML inference services and related ML platform components.
• Build and automate realistic, representative test accounts and datasets to evaluate model behavior across scenarios.
• Validate score distributions, ranking behavior, output quality, and other model signals for incoming ML models prior to release.
• Perform functional, integration, regression and API testing with RESTful APIs and microservices.
• Verify inference service scalability, latency, and reliability under production-like conditions.
• Collaborate with ML engineers and operations teams to ensure automated test coverage for new features and fixes.
• Debug and analyze test failures, model anomalies, and report defects.
• Develop best practices for scalable and maintainable test automation.
• Monitor test execution and optimize performance in test environments.

Skills

Problem solving

Communication

Education

Bachelor's degree in Computer Science or related field

Tools

Python

Java

Scala

Go

Postman

Jenkins

GitHub Actions

ArgoCD

pytest

JUnit

TestNG

Docker

Kubernetes

AWS

GCP

Prometheus

Grafana

Datadog

Seldon

KServe

Ray Serve

Job description

Sony Interactive Entertainment in the United States is seeking a Senior Software Development Engineer in Test, ML to join the Madison team and lead quality efforts for machine learning-powered products and services.

You will partner with ML engineers, software engineers, product managers, and data partners to build scalable test automation and validation approaches for systems serving PlayStation at global scale.