AI QA Lead: Architect Scalable Testing & Quality

HighLevel; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

HighLevel is seeking a Lead Software Development Engineer in Test to drive AI quality across the platform. You will define QA strategy, architect scalable automation for AI products, and own the quality charter for the AI vertical.

You will lead cross-functional QA efforts, coach a growing team, and influence architecture decisions to ensure scaling, reliability, and bias mitigation in production AI workloads.

Qualifications

• 6+ years of experience in QA/SDET roles.
• Deep expertise in AI tools and model testing.
• Design scalable test approaches for RAG, hallucination, drift and bias.
• Architect large-scale, reusable automation frameworks.
• Leadership to coach and upskill an entire team.

Responsibilities

• Define overall QA strategy and architect large-scale automation frameworks.
• Drive quality initiatives and own the AI vertical quality charter.
• Own decisions on test strategy, tools, frameworks, and AI testing methodologies.
• Coach and upskill the team and build a talent pipeline.
• Influence cross-functional teams and participate in architecture discussions.
• Align testing with business strategy and ensure end-to-end quality compliance.
• Shape AI quality roadmap and reduce organizational risk.

Skills

QA/SDET experience

AI model testing

Automation frameworks

Leadership / coaching

Cross-functional influence

Test strategy / decision making

RAG testing

Tools

CI/CD

AWS

GCP

Azure

MLOps

Job description

HighLevel is seeking a Lead Software Development Engineer in Test to drive AI quality across the platform. You will define QA strategy, architect scalable automation for AI products, and own the quality charter for the AI vertical.

You will lead cross-functional QA efforts, coach a growing team, and influence architecture decisions to ensure scaling, reliability, and bias mitigation in production AI workloads.