Senior SDET - AI & Automation, Remote

Keeper Security; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical/Dental/Vision

Life Insurance

Disability Insurance

401K

Paid PTO

Job summary

Keeper Security is seeking a Senior SDET, AI & Automation to join our AI team and help build a modern, automated approach to quality across AI-powered products. This is a 100% remote position, with an option for a hybrid schedule for candidates in El Dorado Hills, CA or Chicago, IL.

As a Senior SDET, you will partner with AI engineers and Product to define test strategy, acceptance criteria and automation coverage for AI-driven capabilities; you will design deterministic and probabilistic

Qualifications

• 5+ years in SDET or code-intensive QA roles
• Hands-on testing AI/ML or model-integrated software
• Strong programming in Python, Java, JavaScript/TypeScript or Rust
• Experience building automated test frameworks
• Experience CI/CD integration (GitHub Actions, Jenkins, GitLab CI)
• Experience with REST APIs and distributed workflows
• Agile software development experience
• FedRAMP eligibility: US Person (US citizen or permanent resident)
• Bachelor’s degree in CS/Engineering or equivalent
• Excellent communication and collaboration skills

Responsibilities

• Define test strategy and acceptance criteria with AI engineers and Product
• Design and maintain automated testing frameworks for AI-powered apps and services
• Develop testing strategies for deterministic and non-deterministic AI outputs
• Establish evaluation criteria, tolerances, and QA thresholds for AI models
• Build automated regression, integration, API and end-to-end coverage
• Create test utilities for prompts, models, agents, tool-calling workflows
• Validate AI behavior across models, prompts, and configurations
• Integrate tests into CI/CD pipelines and build quality gates
• Track test coverage using TestRail or similar tools
• Reduce flaky tests and improve maintainability of test suites

Skills

Python

Java

JavaScript/TypeScript

Test automation

CI/CD

AI/ML testing

GitHub Actions

CI/CD tooling

Education

Bachelor's degree in CS/Engineering

Tools

Postman

REST Assured

JUnit

TestRail

Docker

Kubernetes

Job description

Keeper Security is seeking a Senior SDET, AI & Automation to join our AI team and help build a modern, automated approach to quality across AI-powered products. This is a 100% remote position, with an option for a hybrid schedule for candidates in El Dorado Hills, CA or Chicago, IL.

As a Senior SDET, you will partner with AI engineers and Product to define test strategy, acceptance criteria and automation coverage for AI-driven capabilities; you will design deterministic and probabilistic