Head of Testing & AI-Driven Automation

OpenKrill; United States; Remote; USD 180,000 - 260,000; Full time

Benefits offered by this job

Competitive salary

Flexible working hours

Benefits package

Job summary

Function Health is seeking a hands-on engineering leader to design and build testing and automation systems that enable confident software releases. You will set technical direction and craft practical solutions that verify product behavior, detect regressions, and leverage AI to reduce repetitive testing work.

You will define the testing roadmap with Engineering and Product, create reusable infrastructure, and integrate CI/CD across product surfaces to improve reliability and efficiency.

Qualifications

• Strong software engineering and ownership of automation, quality infrastructure, or related tooling.
• Experience making verification reliable in a delivery pipeline and debugging across code, data, and infrastructure.
• Practical experience building with LLMs or agents and evaluating their outputs.
• Technical leadership with clear judgment about quality, delivery, and adoption tradeoffs.
• Experience with browser or computer-use agents, AI evaluation, and sensitive-data products.

Responsibilities

• Define the testing and automation roadmap with Engineering and Product, starting with priority workflows and release risks.
• Build reusable test infrastructure, repeatable environments, test data, and CI/CD integration across the agreed product surfaces.
• Develop AI-assisted test creation, exploration, maintenance, and failure investigation; evaluate computer-use agents where they fit.
• Establish meaningful assertions, reproducible failure evidence, and release criteria that independently check agent output.
• Measure escaped defects, flaky tests, verification time, false alarms, and maintenance effort; help teams adopt the system through implementation, documentation, and coaching.

Skills

Software engineering

Verification in delivery pipeline

LLMs/agents experience

Technical leadership

Browser/AI automation

Tools

Playwright

Automation tooling

Job description

Function Health is seeking a hands-on engineering leader to design and build testing and automation systems that enable confident software releases. You will set technical direction and craft practical solutions that verify product behavior, detect regressions, and leverage AI to reduce repetitive testing work.

You will define the testing roadmap with Engineering and Product, create reusable infrastructure, and integrate CI/CD across product surfaces to improve reliability and efficiency.