Senior AI Automation QA Engineer

Socket.dev; Seattle (WA); On-site; USD 140,000 - 210,000; Full time

Job summary

Socket.dev in Seattle seeks a Senior Automation & AI Engineer to join the Quality Engineering team, focusing on backend and services testing with deep expertise in LLMs, AI agents, and intelligent pipelines.

Day-to-day involves bug reporting, test plan documentation, and writing test case automation, in close collaboration with engineering and program management. You will drive CI/CD testing for high-volume releases.

Qualifications

• Bachelor's degree in Computer Science or equivalent experience.
• 5+ years of experience in test automation.
• Experience with API/server-side automation.
• Experience programming in a high-level language such as Java.
• Experience with databases and SQL.
• Experience creating test plans and QA processes.
• Experience with prompt engineering, model fine-tuning, or integrating LLM APIs (e.g., OpenAI, Gemini, or on-device models).

Responsibilities

• Bug reporting and isolation, test plan documentation, and writing test case automation.
• Work spans CI/CD pipelines and web service testing to qualify enterprise-grade releases.
• Collaborate with engineering and program management to drive quality outcomes.

Skills

Test automation

API testing

Java

SQL

CI/CD pipelines

LLM integration

QA tooling

Education

Bachelor's degree in Computer Science or equivalent

Tools

Gradle

Maven

JUnit

Selenium

Playwright

Docker

Kubernetes

Job description

Socket.dev in Seattle seeks a Senior Automation & AI Engineer to join the Quality Engineering team, focusing on backend and services testing with deep expertise in LLMs, AI agents, and intelligent pipelines.

Day-to-day involves bug reporting, test plan documentation, and writing test case automation, in close collaboration with engineering and program management. You will drive CI/CD testing for high-volume releases.