Lead Software Development Engineer in Test - AI

HighLevel

United States

Teletrabalho

USD 180 000 - 240 000

Tempo integral

Há 11 dias

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

HighLevel is seeking a Lead Software Development Engineer in Test with deep expertise in AI tools and model testing. You will define QA strategy, architect automation frameworks, and drive quality initiatives for our AI products.

You will own the AI quality roadmap, coach a growing team, and influence cross-functional partners to deliver scalable, reliable software across our platform. Join a remote-first company serving agencies and SMBs worldwide, focusing on robust testing practices,

Qualificações

  • 7+ years in QA/SDET roles.
  • Deep expertise in AI tools & model testing for RAG, hallucination, drift, bias.
  • Experience architecting large-scale automation frameworks.
  • Strong leadership to coach teams and set best practices.
  • Influence across functional teams and architecture discussions.
  • Own decisions on test strategy and AI testing methodologies.

Responsabilidades

  • Define QA strategy and architect cross-platform automation.
  • Drive quality initiatives and own the AI vertical quality charter.
  • Design scalable test approaches for RAG, hallucination, drift, bias.
  • Make decisions on tools, frameworks and AI testing methodologies.
  • Coach the team and build talent pipeline.
  • Influence cross-functional teams and align testing with business strategy.
  • Own end-to-end quality strategy at the product level.
  • Shape AI quality roadmap and improve scalability and reliability.

Conhecimentos

QA/SDET experience
AI testing
Automation frameworks
Leadership
Cross-functional collaboration
Test architecture
RAG testing

Ferramentas

CI/CD pipelines
AWS/GCP/Azure

Descrição da oferta de emprego

About HighLevel:

About HighLevel: HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. Today, HighLevel supports SMBs across 150+ countries, fueling community-driven growth rooted in real customer outcomes. To date, businesses operating on HighLevel have generated over $7 billion in ecosystem value, demonstrating the impact of shared infrastructure at scale. By centralizing conversations, automation and intelligence into one system, we help businesses move faster, reduce complexity and execute efficiently. Behind the platform, HighLevel powers more than 4 billion API hits and 2.5 billion message events daily. With 250 terabytes of distributed data, 250+ microservices and over 1 million domain names supported, our architecture is built for performance, resilience and long-term scalability. Our People With over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership. We value initiative, clarity and execution, creating space for ambitious people to build systems that support millions of businesses worldwide. Here, innovation thrives, ideas are celebrated and people come first, no matter where they call home. Our Impact Every month, HighLevel enables more than 1.5 billion messages, 200 million leads and 20 million conversations for the more than 1 million businesses we support. Behind those numbers are real people building independence, expanding opportunity and creating measurable impact. We’re proud to be a part of that. Learn more about us on our YouTube Channel or Blog Posts.

About the Role:

We are looking for a Lead Software Development Engineer in Test with deep expertise in AI tools and model testing. This role requires an individual who can define overall QA strategy, architect automation frameworks, and drive organisation-wide quality initiatives for our AI products. You will own the quality charter for the AI vertical, influence cross-functional teams, and play a key role in shaping the AI quality roadmap.

Requirements:
  • 7+ years of overall experience in QA/SDET roles
  • Deep expertise in AI tools & model testing, responsible for designing scalable test approaches for RAG, hallucination, drift, and bias
  • Proven experience in architecting large-scale, reusable, cross-platform automation frameworks
  • Strong leadership skills to coach and upskill an entire team, set best practices, and build a talent pipeline
  • Ability to influence cross-functional teams and participate in architecture discussions
  • Strong problem-solving skills with the ability to own decisions on test strategy, tools, frameworks, and AI testing methodologies
Responsibilities:
  • Define overall QA strategy and architect large-scale, reusable, cross-platform automation frameworks
  • Drive organization-wide quality initiatives and own the quality charter for the AI vertical
  • Possess deep expertise in AI tools & model testing, responsible for designing scalable test approaches for RAG, hallucination, drift, and bias
  • Own decisions on test strategy, tools, frameworks, and AI testing methodologies
  • Coach and upskill the entire team, set best practices, and build talent pipeline
  • Influence cross-functional teams, participate in architecture discussions, and align testing with business strategy
  • Responsible for end-to-end quality strategy at the product/vertical level
  • Shape AI quality roadmap, reduce organization-wide risk, and improve scalability and reliability
Bonus Points:
  • Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure).
  • Familiarity with MLOps pipelines and monitoring AI systems.
  • Exposure to performance and scalability testing of AI workloads.
EEO Statement:

The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government recordkeeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision. We encourage you to review our Privacy Policy before submitting your application

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Lead Software Development Engineer in Test - AI
Lead Software Development Engineer in Test - AI

HighLevel • Texas

Híbrido
USD 140 000 - 200 000
Engineering Manager II, SDET
Engineering Manager II, SDET

HighLevel • EUA

Teletrabalho
USD 180 000 - 240 000
Software Development Engineer in Test III - Core Modules
Software Development Engineer in Test III - Core Modules

HighLevel • EUA

Teletrabalho
USD 27 000 - 43 000
Remote-first
Competitive salary
Head of AI Quality & SDET Strategy
Head of AI Quality & SDET Strategy

HighLevel • EUA

Teletrabalho
USD 180 000 - 240 000
Lead Software Engineer In Test
Lead Software Engineer In Test

RapidCanvas • EUA

Teletrabalho
USD 140 000 - 190 000
Senior/Tech Lead QA (with AI experience)
Senior/Tech Lead QA (with AI experience)

N-iX LTD • EUA

Híbrido
USD 70 000 - 110 000
Flexible remote/office-based work
Competitive salary
Career growth and mentoring
+2
Quality Assurance Automation Engineer
Quality Assurance Automation Engineer

VetRamp • Dallas (TX)

Híbrido
USD 90 000 - 130 000
Employer-paid health insurance for you
Dental, vision, 401k and disability
Flexible remote/work-from-home options
+1
AI Quality & Test Strategy Leader
AI Quality & Test Strategy Leader

HighLevel • Texas

Híbrido
USD 140 000 - 200 000
Automation Test Engineer
Automation Test Engineer

Apt • Birmingham (AL)

Presencial
USD 90 000 - 130 000
Senior Staff SDET (Customer Engineering)
Senior Staff SDET (Customer Engineering)

Hims & Hers Health, Inc. • EUA

Teletrabalho
USD 180 000 - 240 000
Generous PTO
Full healthcare
401(k) with matching
+1