Staff Software Engineer, Testing & AI Evaluation Frameworks

Idme

McLean, Mountain View (VA, CA)

On-site

USD 150,000 - 190,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

ID.me in McLean, VA is seeking a Staff Engineer who will own the architecture and strategy for evaluation frameworks, automation tools, and testing infrastructure across services. It requires deep engineering rigor, mentoring, and collaboration with security and product teams to embed quality at every development stage.

You will lead AI-assisted testing practices and drive CI/CD quality gates, ensuring reliable, secure software delivery for a platform that verifies identities at scale.

Qualifications

  • 10+ years of software engineering experience in modern web apps and distributed systems.
  • Proficiency in Python, TypeScript, JavaScript, and Java.
  • Hands-on with Playwright, Jest, API automation, or evaluation frameworks.
  • Experience integrating automated tests into CI/CD pipelines (GitHub Actions, ArgoCD).
  • Proven ability to lead cross-team technical initiatives and mentor engineers.
  • Strong written and verbal communication across engineering, product, and leadership.

Responsibilities

  • Own test architecture and long-term automation strategy across services.
  • Define end-to-end and integration testing for distributed systems.
  • Lead testing-in-production through canaries, phased rollouts, and automated rollbacks.
  • Own security-focused test automation (OAuth2, RBAC, secrets).
  • Integrate automated testing into CI/CD pipelines org-wide (GitHub Actions).
  • Drive AI eval culture and use AI to accelerate test authoring and reviews.
  • Collaborate with Security, Platform and Product teams to embed quality throughout development.

Skills

Programming languages (Python/TypeS/JS
Test frameworks
CI/CD
Cross-team leadership
Mentoring
Communication

Education

10+ years software engineering
Master's degree in CS
PhD with 5+ years

Tools

Playwright
Jest
API automation
GitHub Actions
ArgoCD
Locust
Gatling

Job description

ID.me in McLean, VA is seeking a Staff Engineer who will own the architecture and strategy for evaluation frameworks, automation tools, and testing infrastructure across services. It requires deep engineering rigor, mentoring, and collaboration with security and product teams to embed quality at every development stage.

You will lead AI-assisted testing practices and drive CI/CD quality gates, ensuring reliable, secure software delivery for a platform that verifies identities at scale.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Software Engineer - AI Evals & Testing Frameworks
Staff Software Engineer - AI Evals & Testing Frameworks

iDme Technologies Corp • Washington

On-site
USD 174,000 - 229,000
Medical, dental, vision
401(k) with company match
Paid time off
+2
Staff Software Engineer: AI Eval & Testing Platform
Staff Software Engineer: AI Eval & Testing Platform

ID.me, Inc. • McLean (VA), Mountain View (CA)

On-site
USD 174,000 - 229,000
Senior Software Engineer - Testing Tools & AI-Driven QA
Senior Software Engineer - Testing Tools & AI-Driven QA

ID.me • San Francisco (CA)

On-site
USD 191,000 - 231,000
Staff Software Engineer – Testing & Evals Frameworks
Staff Software Engineer – Testing & Evals Frameworks

Idme • McLean (VA), Mountain View (CA)

On-site
USD 150,000 - 190,000
Staff Software Engineer - AI-Driven Member Support Apps
Staff Software Engineer - AI-Driven Member Support Apps

iDme Technologies Corp • McLean (VA)

On-site
USD 183,000 - 215,000
Medical, dental, vision insurance
401(k) with company match
Unlimited PTO and holidays
Software Engineer, AI Platform & Developer Experience
Software Engineer, AI Platform & Developer Experience

Idme • McLean (VA)

On-site
USD 140,000 - 190,000
Senior Test Automation Engineer – AI-Driven QA
Senior Test Automation Engineer – AI-Driven QA

ID.me • San Francisco (CA)

On-site
USD 124,000 - 154,000
Senior DevEx & AI Platform Engineer
Senior DevEx & AI Platform Engineer

iDme Technologies Corp • McLean (VA)

On-site
USD 120,000 - 159,000
Medical benefits
401(k) with company match
Paid time off
+1
Staff Software Engineer, Trust Service Platform
Staff Software Engineer, Trust Service Platform

ID.me University Recruiting • Mountain View (CA)

On-site
USD 218,000 - 271,000
Medical, dental, vision
401(k) with company match
Parental leave
+2
Senior DevEx & AI Platform Engineer
Senior DevEx & AI Platform Engineer

ID.me, Inc. • McLean (VA)

On-site
USD 150,000 - 210,000