Lead Software Development Engineer in Test - AI

HighLevel; Texas; Hybrid; USD 140,000 - 200,000; Full time

Job summary

HighLevel is seeking a Lead Software Development Engineer in Test with deep expertise in AI tools and model testing to define QA strategy and automation across our AI products. You will own the AI quality roadmap, architect reusable test frameworks, and coach teams, influencing cross-functional stakeholders to improve scalability and reliability.

The role requires 7+ years in QA/SDET, strong leadership, and the ability to drive organization-wide quality initiatives in a fast-paced AI

Qualifications

• 7+ years of experience in QA/SDET roles.
• Deep expertise in AI tools and model testing for RAG, hallucination, drift, and bias.
• Experience architecting large-scale, reusable automation frameworks.
• Strong leadership to coach and upskill an entire team and set best practices.
• Ability to influence cross-functional teams and participate in architecture discussions.
• Strong problem-solving skills with ownership of test strategy and AI testing methodologies.

Responsibilities

• Define overall QA strategy and architect large-scale automation frameworks.
• Drive organization-wide quality initiatives and own the AI vertical quality charter.
• Design scalable test approaches for AI workloads and model testing.
• Own decisions on test strategies, tools, and methodologies.
• Coach and upskill the team and build a talent pipeline.
• Influence cross-functional teams and align testing with business strategy.
• Shape an AI-quality roadmap and improve scalability and reliability.

Skills

QA/SDET leadership

Automation framework design

AI tools

Model testing

Cross-functional influence

Test strategy

Mentoring/upskilling

Tools

CI/CD pipelines

Cloud platforms (AWS/GCP/Azure)

Job description

We are looking for a Lead Software Development Engineer in Test with deep expertise in AI tools and model testing. This role requires an individual who can define overall QA strategy, architect automation frameworks, and drive organization-wide quality initiatives for our AI products. You will own the quality charter for the AI vertical, influence cross-functional teams, and play a key role in shaping the AI quality roadmap.

Responsibilities

• Define overall QA strategy and architect large-scale, reusable, cross-platform automation frameworks.
• Drive organization-wide quality initiatives and own the quality charter for the AI vertical.
• Possess deep expertise in AI tools and model testing, responsible for designing scalable test approaches for RAG, hallucination, drift, and bias.
• Own decisions on test strategy, tools, frameworks, and AI testing methodologies.
• Coach and upskill the entire team, set best practices, and build a talent pipeline.
• Influence cross-functional teams, participate in architecture discussions, and align testing with business strategy.
• Responsible for end-to-end quality strategy at the product/vertical level.
• Shape an AI-quality roadmap, reduce organization-wide risk, and improve scalability and reliability.

Requirements

• 7+ years of overall experience in QA/SDET roles.
• Deep expertise in AI tools and model testing, responsible for designing scalable test approaches for RAG, hallucination, drift, and bias.
• Proven experience in architecting large-scale, reusable, cross-platform automation frameworks.
• Strong leadership skills to coach and upskill an entire team, set best practices, and build a talent pipeline.
• Ability to influence cross-functional teams and participate in architecture discussions.
• Strong problem-solving skills with the ability to own decisions on test strategy, tools, frameworks, and AI testing methodologies.

Bonus Points

• Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure).
• Familiarity with MLOps pipelines and monitoring AI systems.
• Exposure to performance and scalability testing of AI workloads.