Staff Software Engineer: AI Eval & Testing Platform

ID.me, Inc.

McLean, Mountain View (VA, CA)

On-site

USD 174,000 - 229,000

Full time

3 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

ID.me is seeking a Staff Engineer to own architecture and strategy for evaluation frameworks, automation tools, and testing infrastructure across services. You will mentor engineers, champion AI‑assisted testing, and collaborate with security, product, and platform teams to embed quality throughout development.

You will lead canary rollouts, address complex, event‑driven systems, and ensure robust test coverage and CI/CD quality gates across the org.

Qualifications

10+ years as software engineer with web apps and distributed systems.
Hands‑on with Playwright, Jest, API automation, or eval frameworks.
Experience integrating tests into CI/CD (GitHub Actions, ArgoCD).
Lead cross‑team initiatives and raise engineering standards.
Mentor senior engineers and improve quality across teams.
Strong written and verbal communication across teams.

Responsibilities

Own Test Architecture & Strategy for automation frameworks and testing infrastructure.
Define end-to-end and integration testing for distributed systems.
Drive testing‑in‑production, canary deployments, and synthetic monitoring.
Own security‑focused test automation (OAuth, RBAC, secrets).
Integrate automated testing into CI/CD pipelines org-wide.
Build eval pipelines for AI features and LLM agents.
Partner with Security, Platform, and Product teams on testability.
Mentor engineers on test architecture and quality practices.
Debug and root‑cause issues across frontend, backend, APIs, and services.
Define reliability metrics for evaluation programs.