Senior ML/AI SDET - Quality Automation Lead

PlayStation

Madison (WI)

On-site

USD 153,000 - 229,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sony Interactive Entertainment in the United States is seeking a Sr. Software Development Engineer in Test, ML/AI to join our ML quality team in Madison, WI.

You will guide quality strategy for ML-powered services, build automation, and collaborate with ML, engineering, product, and infrastructure to ship reliable AI features. The role requires 5+ years as an SDET/QE, strong automation in Python/Java, testing REST APIs and distributed systems, CI/CD, cloud platforms, and AI evaluation tooling to

Qualifications

  • Bachelor’s degree in CS or equivalent.
  • 5+ years as SDET/QE for backend/distributed systems.
  • Experience using LLMs to generate and prioritize test cases for AI.
  • Experience with AI evaluation tooling and model monitoring.
  • Strong testing for REST APIs, microservices, and distributed tech.
  • Proficient in Python or Java for automation.
  • Hands-on with pytest/JUnit/Selenium/Playwright.
  • CI/CD experience (Jenkins, GitHub Actions).
  • Cloud and container tech (AWS/GCP, Kubernetes, Docker).
  • Familiar with databases, monitoring, observability.
  • Strong SDLC/Agile/release-process knowledge.
  • Excellent problem-solving and communication.

Responsibilities

  • Define and complete quality strategies and test plans for ML-powered services.
  • Use LLMs to generate and prioritize test cases for AI workflows.
  • Design scenario-based test suites for AI features and edge cases.
  • Lead QE across multi-functional projects, manage dependencies.
  • Develop scalable automation frameworks for backend services and ML inference.
  • Validate ML/LLM outputs, including prompt quality and hallucination indicators.
  • Debug test failures and AI regressions to identify root causes.
  • Integrate automated testing into CI/CD pipelines.

Skills

SDET
Python
Java
REST APIs
CI/CD
LLM testing
Test automation
Distributed systems
Debugging
Cloud (AWS/GCP)

Education

Bachelor's degree in CS or equivalent

Tools

pytest
JUnit
Selenium
Playwright
Cypress
Jenkins
GitHub Actions
AWS
Kubernetes
Docker

Job description

Sony Interactive Entertainment in the United States is seeking a Sr. Software Development Engineer in Test, ML/AI to join our ML quality team in Madison, WI.

You will guide quality strategy for ML-powered services, build automation, and collaborate with ML, engineering, product, and infrastructure to ship reliable AI features. The role requires 5+ years as an SDET/QE, strong automation in Python/Java, testing REST APIs and distributed systems, CI/CD, cloud platforms, and AI evaluation tooling to

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior ML Testing & Automation Engineer (SDET)
Senior ML Testing & Automation Engineer (SDET)

Sony • Madison (WI)

On-site
USD 120,000 - 180,000
Medical, dental, vision benefits
401(k) matching
Paid time off
+2
Senior SDET: ML/AI Quality & Automation Lead
Senior SDET: ML/AI Quality & Automation Lead

Sony Interactive Entertainment • Madison (WI)

On-site
USD 153,000 - 229,000
Medical benefits
Dental benefits
Vision benefits
+4
Sr SDET, ML — Scalable Test Automation & Validation
Sr SDET, ML — Scalable Test Automation & Validation

Sony Interactive Entertainment Inc. • Madison (WI)

Hybrid
USD 152,000 - 190,000
Medical benefits
Dental benefits
Vision benefits
+3
Senior ML SDET: Test Automation & Model Validation
Senior ML SDET: Test Automation & Model Validation

Sony Playstation • Madison (WI)

On-site
USD 152,000 - 190,000
Senior SDET, AI/ML Testing & Automation
Senior SDET, AI/ML Testing & Automation

PlayStation Global • San Mateo (CA)

On-site
USD 183,000 - 275,000
Senior ML SDET — Automate & Validate ML Systems
Senior ML SDET — Automate & Validate ML Systems

PlayStation • Madison (WI)

On-site
USD 152,000 - 190,000
Medical, dental, vision
401(k) matching
Paid time off
+1
Senior SDET, ML – Test Automation for ML Systems
Senior SDET, ML – Test Automation for ML Systems

Game Companies • Madison (WI)

On-site
USD 152,000 - 190,000
Medical, dental, vision benefits
401(k) matching
Paid time off
+2
SDET: AI-Driven Backend Quality Engineer
SDET: AI-Driven Backend Quality Engineer

PlayStation Global • Aliso Viejo (CA)

On-site
USD 80,000 - 99,000
Senior SDET & QA Automation Architect (ML & CI/CD)
Senior SDET & QA Automation Architect (ML & CI/CD)

sonyinteractiveentertainmentglobal • United States

On-site
USD 140,000 - 190,000
Medical
Dental
Vision
+4
AI/LLM SDET Engineer - QA for Agentic AI
AI/LLM SDET Engineer - QA for Agentic AI

Sony Interactive Entertainment • Aliso Viejo (CA)

On-site
USD 80,000 - 99,000