AI Quality & Test Automation Engineer

Socket.dev; Cupertino (CA); On-site; USD 140,000 - 210,000; Full time

Job summary

Socket.dev is seeking an AI Quality & Test Automation Engineer to elevate the quality bar for AI-powered features used across the organization.

You will design automated systems to validate infrastructure changes, surface anomalies, and accelerate engineering workflows, collaborating closely with cross-functional partners to translate real-world pain points into scalable automation.

Qualifications

• 6+ years of experience in software development or QA across full-stack, frontend, backend, or integrated QA.
• 2+ years using AI tools to automate tasks in daily engineering workflows.
• Proficiency in Python, Ruby, or Swift for automation or web development.
• Experience with observability and logging in Kubernetes-based environments.
• Bachelor's degree in CS, Software Engineering, or a related technical field, or equivalent practical experience.

Responsibilities

• Design and build intelligent automated systems validating infrastructure changes.
• Detect anomalies and continuously improve AI feature quality.
• Collaborate with cross-functional partners to translate pain points into scalable automation.
• Contribute to reducing outages and accelerating engineering workflows.

Skills

Full-stack development

QA automation

AI tooling experience

Scripting languages

Observability & logging

Cross-team communication

Education

Bachelor's degree in CS/Software Engineering

Tools

CI/CD pipelines

Kubernetes tooling

Job description

The Apps Services team elevates the development and delivery process that ships code to billions of users worldwide. We build tools and systems that drive efficiency across every stage of the pipeline - from commit to customer. As an AI Quality & Test Automation Engineer, you'll be at the forefront of applying AI to proactively hunt edge cases, surface anomalies, and raise the quality bar for AI-powered features relied upon by teams across the organization.

Description

In this role, you'll design and build intelligent, automated systems that validate infrastructure changes, detect anomalies, and continuously improve the quality of AI features used by customer teams. You'll also help establish the foundational layer of a growing suite of internal applications aimed at reducing critical outages and accelerating engineering workflows. Day to day, you'll collaborate closely with cross-functional partners, translating real operational pain points into elegant, scalable automation solutions.

Minimum Qualifications

6+ years of experience in software development or QA, spanning full-stack, frontend, backend, or integrated QA roles2+ years of hands-on experience leveraging AI tools in daily engineering workflows to automate tasks and build automated systemsProficiency in one or more scripting languages used for system automation or web development, such as Python, Ruby, or SwiftDemonstrated ability to work effectively with observability and logging tooling in Kubernetes-based environmentsStrong cross-team communication skills with a track record of collaborating effectively with partner engineering organizationsBachelor's degree in Computer Science, Software Engineering, or a related technical field, or we may consider an equivalent practical experience

Preferred Qualifications

Swift application development experience, with familiarity building native or server-side Swift toolsProven experience meeting with stakeholders to distill ambiguous requests into well-defined workflows, engineering requirements, and measurable outcomesFamiliarity with CI/CD pipeline architecture and integrating quality gates into automated delivery workflowsExperience building internal developer tooling or platform engineering systems used at organizational scale