Staff Software Engineer - AI Evals & Testing Frameworks

iDme Technologies Corp; Washington (District of Columbia); On-site; USD 174,000 - 229,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k) with company match

Paid time off

Wellbeing and childcare discounts

Learning and development benefit

Job summary

ID.me is seeking a Staff Engineer to own the architecture and strategy for evaluation frameworks, automation tools, and testing infrastructure that give ID.me engineering teams the confidence to ship quickly and safely. You will mentor engineers and partner with security, product, and platform teams to embed quality into every stage of development for a platform that verifies millions of users.

You will lead testing for distributed systems, CI/CD quality gates, and testing-in-production

Qualifications

• 10+ years of software engineering in modern web apps and distributed systems.
• Proficiency in Python/TypeScript/JavaScript/Java.
• Hands-on with Playwright, Jest, API automation, and CI/CD tooling.
• Experience leading cross-team technical initiatives and mentoring engineers.
• Strong written and verbal communication across teams.

Responsibilities

• Own test architecture and long-term strategy for automation and testing infra.
• Define end-to-end and integration testing for distributed systems.
• Champion testing-in-production, canary deployments, and automated rollbacks.
• Set security-focused test automation around OAuth/OIDC, RBAC, secrets management.
• Integrate automated testing into CI/CD pipelines across the org.
• Build AI eval pipelines and apply AI tools to accelerate test authoring and reviews.
• Collaborate with Security, Platform, and Product teams to improve code quality.
• Mentor senior engineers on test architecture and quality practices.
• Debug frontend, backend, and API issues to drive fixes.
• Define reliability metrics and track quality across services.

Skills

Python

TypeScript

JavaScript

Java

Strong communication

Education

Bachelor's degree or higher in CS/Engineering

Master's degree preferred

Tools

Playwright

Jest

API automation

GitHub Actions

ArgoCD

Temporal

Job description

ID.me is seeking a Staff Engineer to own the architecture and strategy for evaluation frameworks, automation tools, and testing infrastructure that give ID.me engineering teams the confidence to ship quickly and safely. You will mentor engineers and partner with security, product, and platform teams to embed quality into every stage of development for a platform that verifies millions of users.

You will lead testing for distributed systems, CI/CD quality gates, and testing-in-production