Remote Head of Testing & AI Automation

Function Health

United States

Remote

USD 180,000 - 280,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible working hours

Job summary

Function Health is seeking a hands-on Head of Testing and Automation to build scalable testing and AI-assisted verification across our platform. You will set technical direction, own testing strategy, and lead a team to improve reliability and release confidence.

You will architect reusable test infrastructure, CI/CD integration, and evaluation of AI agents, balancing speed and quality while ensuring data safety and auditability.

Qualifications

  • Strong software engineering and hands-on ownership of automation, quality infrastructure, developer tooling, or comparable systems.
  • Experience making verification reliable in a delivery pipeline and debugging failures across code, data, and infrastructure.
  • Practical experience building with LLMs or agents and evaluating their outputs.
  • Technical leadership across teams, with clear judgment about quality, delivery, and adoption tradeoffs.
  • Experience with browser or computer-use agents, Playwright or similar automation, AI evaluation, and sensitive-data products.

Responsibilities

  • Define the testing and automation roadmap with Engineering and Product, starting with priority workflows and release risks.
  • Build reusable test infrastructure, repeatable environments, test data, and CI/CD integration across the agreed product surfaces.
  • Develop AI-assisted test creation, exploration, maintenance, and failure investigation; evaluate computer-use agents where they fit.
  • Establish meaningful assertions, reproducible failure evidence, and release criteria that independently check agent output.
  • Measure escaped defects, flaky tests, verification time, false alarms, and maintenance effort; help teams adopt the system through implementation, documentation, and coaching.

Skills

Strong software engineering
Delivery pipeline verification
LLMs/agents experience
Tech leadership
Automation & AI evaluation

Tools

Playwright
LLM tooling

Job description

Function Health is seeking a hands-on Head of Testing and Automation to build scalable testing and AI-assisted verification across our platform. You will set technical direction, own testing strategy, and lead a team to improve reliability and release confidence.

You will architect reusable test infrastructure, CI/CD integration, and evaluation of AI agents, balancing speed and quality while ensuring data safety and auditability.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead, AI-Driven Testing & Quality Automation
Lead, AI-Driven Testing & Quality Automation

Function • United States

On-site
USD 140,000 - 210,000
401k Match
Choose your own holidays
Health Insurance
Head of Testing and Automation
Head of Testing and Automation

Function • United States

On-site
USD 140,000 - 210,000
401k Match
Choose your own holidays
Health Insurance
Senior Automation QA Engineer: Lead End-to-End Testing & AI
Senior Automation QA Engineer: Lead End-to-End Testing & AI

EthicalHat Cyber Security • United States

Remote
USD 120,000 - 160,000
Senior SDET: AI-Driven Test Automation Lead
Senior SDET: AI-Driven Test Automation Lead

Midwest Startups • Lehi (UT)

Hybrid
USD 120,000 - 150,000
Healthcare
401k match
Parental leave
+3
Senior Staff SDET — AI-Driven Quality Architect
Senior Staff SDET — AI-Driven Quality Architect

Hims And Hers • United States

Remote
USD 180,000 - 230,000
Automation & Quality Engineer — AI-Driven Testing
Automation & Quality Engineer — AI-Driven Testing

Subway Group • Shelton (CT)

Hybrid
USD 90,000 - 120,000
Senior QA Quality Cell Lead - AI-Driven Testing (Remote)
Senior QA Quality Cell Lead - AI-Driven Testing (Remote)

HumanIT Digital Consulting • United States

Remote
USD 120,000 - 160,000
Remote Senior QA Automation Engineer — AI-Driven Testing
Remote Senior QA Automation Engineer — AI-Driven Testing

Remote • San Francisco (CA)

Remote
USD 64,000 - 92,000
Competitive salary and stock options
Medical, dental & vision insurance
Flexible PTO
+2
Remote Head of Quality Engineering & Responsible AI
Remote Head of Quality Engineering & Responsible AI

Partner Company • United States

Remote
USD 180,000 - 260,000
Fully remote US
Unlimited PTO
Home-office equipment
+2
Senior Quality Engineer - AI-Driven Test Automation
Senior Quality Engineer - AI-Driven Test Automation

8 West Consulting • United States

Remote
USD 90,000 - 130,000