AI Test Lead - Remote, ML Quality & Strategy

Pinnacle Talent Placement; United States; Teletrabalho; USD 140 000 - 180 000; Tempo integral

Resumo da oferta

Pinnacle Talent Placement is seeking an AI Test Lead for remote work with some travel to Atlanta, GA. You will own the quality strategy for AI-powered applications and models, defining end-to-end AI testing approaches and leading execution with modern AI tools.

The role requires 10+ years in software QA with 2+ years in AI/ML testing, hands-on testing tools, and strong leadership skills to mentor testers and collaborate across data science, engineering, and product teams.

Qualificações

• 10+ years in software QA/testing, with 2+ years hands-on testing AI/ML applications and models.
• Hands-on with AI-based testing tools and test automation.
• Ability to create and drive AI testing strategy from the ground up.

Responsabilidades

• Define and own the AI testing strategy for applications and models.
• Lead AI application testing across functional, integration, and user-facing behavior.
• Perform model testing and validation (accuracy, robustness, bias, drift, hallucination, and performance).
• Leverage AI-powered testing tools to design, automate, and accelerate test coverage.
• Establish Agentic test frameworks, quality gates, and acceptance criteria for AI features.
• Collaborate with data science, engineering, and product teams to embed quality early.
• Report on quality metrics, risks, and readiness for release.

Conhecimentos

QA testing

AI/ML testing

Test automation

CI/CD

MLOps

Team leadership

Ferramentas

LangFuse

Langsmith

TestRigor

Functionize

Descrição da oferta de emprego

Pinnacle Talent Placement is seeking an AI Test Lead for remote work with some travel to Atlanta, GA. You will own the quality strategy for AI-powered applications and models, defining end-to-end AI testing approaches and leading execution with modern AI tools.

The role requires 10+ years in software QA with 2+ years in AI/ML testing, hands-on testing tools, and strong leadership skills to mentor testers and collaborate across data science, engineering, and product teams.