AI/LLM SDET Engineer - QA for Agentic AI

Sony Interactive Entertainment; Aliso Viejo (CA); On-site; USD 80,000 - 99,000; Full time

Job summary

Sony Interactive Entertainment is seeking an experienced Software Development Engineer in Test (SDET) to ensure quality, reliability, and resilience of Agentic AI systems and backend services. You will design automated testing strategies across AI/LLM-driven applications, APIs, microservices, and distributed systems.

The ideal candidate will have strong QE fundamentals, hands-on automation, and experience testing Generative AI, LLM-powered, or Agentic AI systems in dynamic environments with

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field, or equivalent practical experience.
• Strong experience testing REST APIs, backend services, microservices, or distributed systems.
• Hands-on experience developing automated tests using Python, Java, JavaScript, TypeScript, or a similar programming language.
• Experience with functional, integration, regression, contract, and end-to-end testing.
• Experience integrating automated tests into CI/CD pipelines.
• Strong analytical, debugging, and root-cause-analysis skills.
• Experience working in an Agile development environment and collaborating across engineering teams.

Responsibilities

• Develop and execute comprehensive QE strategies and test plans for Agentic AI systems, backend services, APIs, and service integrations.
• Design and maintain scalable automated test frameworks across API, functional, integration, contract, regression, and end-to-end testing.
• Develop testing approaches for non-deterministic AI behavior and establish meaningful evaluation criteria.
• Identify quality risks early and apply risk-based, shift-left testing practices throughout the development lifecycle.
• Integrate automated testing into CI/CD pipelines and establish effective quality gates.
• Partner with Software Engineers, Product Managers, and other QE teams to improve testability, observability, and overall product quality.
• Analyze defects and production issues to identify root causes, testing gaps, and opportunities for continuous QE improvement.
• Establish quality metrics and provide visibility into test coverage, reliability, defects, and release readiness.

Skills

API testing

Backend services

Automated tests

Generative AI testing

LLM-powered systems

CI/CD pipelines

Agile

Debugging

Education

Bachelor's degree

Tools

Git

CI/CD tools

Job description

Sony Interactive Entertainment is seeking an experienced Software Development Engineer in Test (SDET) to ensure quality, reliability, and resilience of Agentic AI systems and backend services. You will design automated testing strategies across AI/LLM-driven applications, APIs, microservices, and distributed systems.

The ideal candidate will have strong QE fundamentals, hands-on automation, and experience testing Generative AI, LLM-powered, or Agentic AI systems in dynamic environments with