AI-Driven SDET: Automated Quality for Secure Apps

Keeper Security, Inc.; Northern (KY); Remote; USD 120,000 - 160,000; Full time

Job summary

Keeper Security, Inc. is seeking a Senior Software Development Engineer in Test (SDET) focused on AI & Automation.

This 100% remote role involves partnering with AI engineers to define test strategies, build automated coverage, and ensure quality across AI-powered products. You will work across CI/CD pipelines and stay ahead of non-deterministic AI behavior while maintaining deterministic testing standards.

Qualifications

• 5+ years of experience in SDET or quality engineering
• Hands-on experience testing AI/ML or model-integrated software
• Experience in designing automated test frameworks and CI/CD integration
• Ability to evaluate AI outputs with variability and metrics
• Strong debugging and collaboration skills

Responsibilities

• Define test strategy and acceptance criteria with AI engineers and product managers
• Design and maintain automated testing frameworks for AI-powered apps and APIs
• Develop testing strategies for deterministic and non-deterministic AI outputs
• Integrate automated validation into CI/CD pipelines
• Build test datasets and mocks for repeatable validation
• Analyze failures to distinguish defects from model variability
• Track test coverage and results using TestRail

Skills

SDET experience

AI/ML testing

CI/CD

REST API testing

GitHub Actions

Jenkins

GitLab CI

TestRail

Debugging

Documentation

Education

Bachelor’s degree in CS/Engineering

Tools

Postman

REST Assured

TestRail

GitHub Actions

Jenkins

GitLab CI

Job description

Keeper Security, Inc. is seeking a Senior Software Development Engineer in Test (SDET) focused on AI & Automation.

This 100% remote role involves partnering with AI engineers to define test strategies, build automated coverage, and ensure quality across AI-powered products. You will work across CI/CD pipelines and stay ahead of non-deterministic AI behavior while maintaining deterministic testing standards.