Software Development Engineer in Test III - AI

HighLevel

United States

Remote

USD 120,000 - 180,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

HighLevel is seeking a Senior Software Development Engineer in Test (SDET 3) to lead AI testing efforts, design strategies, and mentor junior engineers in a hands-on capacity. You will work on AI-driven products, ensuring quality across OpenAI, Claude integrations, and RAG flows.

This remote-first role values independent ownership, collaboration with AI researchers, and a focus on scalable automation. You will drive test coverage, performance tuning, and reliable releases for a global customer

Qualifications

  • 5+ years of QA/SDET experience in software testing.
  • Experience testing AI/ML products and AI tools.
  • Hands-on in automation frameworks and test strategy.
  • Experience mentoring and guiding peers or junior engineers.

Responsibilities

  • Design, develop, and maintain automation frameworks and test strategies for AI products.
  • Test and validate AI-powered features (OpenAI, Claude, and integrations).
  • Evaluate and improve RAG flows for accuracy and performance.
  • Leverage AI automation tools to optimize test coverage and efficiency.
  • Collaborate with developers, product managers, and AI researchers to ensure high-quality releases.
  • Own tasks end-to-end and mentor junior SDETs.

Skills

AI testing
Automation experience
Troubleshooting
Mentorship
Independent work
Team collaboration

Tools

Playwright
Cypress
Selenium
Postman
REST
GraphQL
gRPC

Job description

About HighLevel

HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. Today, HighLevel supports SMBs across 150+ countries, fueling community-driven growth rooted in real customer outcomes. To date, businesses operating on HighLevel have generated over $7 billion in ecosystem value, demonstrating the impact of shared infrastructure at scale. By centralizing conversations, automation and intelligence into one system, we help businesses move faster, reduce complexity and execute efficiently. Behind the platform, HighLevel powers more than 4 billion API hits and 2.5 billion message events daily. With 250 terabytes of distributed data, 250+ microservices and over 1 million domain names supported, our architecture is built for performance, resilience and long-term scalability. Our People With over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership. We value initiative, clarity and execution, creating space for ambitious people to build systems that support millions of businesses worldwide. Here, innovation thrives, ideas are celebrated and people come first, no matter where they call home. Our Impact Every month, HighLevel enables more than 1.5 billion messages, 200 million leads and 20 million conversations for the more than 1 million businesses we support. Behind those numbers are real people building independence, expanding opportunity and creating measurable impact. We’re proud to be a part of that. Learn more about us on our YouTube Channel or Blog Posts

About the Role

We are looking for a Senior Software Development Engineer in Test (SDET 3) with strong expertise in AI tools and testing AI-driven products. This role requires a hands‑on individual who can design and execute test strategies for AI systems, automate intelligently, and mentor junior team members. You will work independently, drive tasks to closure, and play a key role in ensuring the quality of our AI initiatives.

Requirements
  • 5+ years of overall experience in QA/SDET roles
  • Proven experience working with AI tools (e.g., OpenAI, Claude, or similar LLM platforms)
  • Strong understanding of testing AI/ML products and their unique challenges
  • Hands‑on knowledge of RAG pipelines and their testing methodologies
  • Proficiency in automation frameworks (e.g., Playwright, Cypress, Selenium, or similar)
  • Experience with API testing (Postman, REST, GraphQL, gRPC)
  • Strong problem‑solving skills with the ability to work independently
  • Mentorship and leadership skills in guiding peers or junior engineers
Responsibilities
  • Design, develop, and maintain automation frameworks and test strategies for AI products
  • Test and validate AI-powered features (including OpenAI, Claude, and other AI integrations)
  • Evaluate and improve RAG (Retrieval-Augmented Generation) flows, ensuring accuracy and performance
  • Leverage AI automation tools to optimize test coverage and efficiency
  • Collaborate closely with developers, product managers, and AI researchers to ensure high-quality releases
  • Own tasks end-to-end, working independently to deliver on commitments.
  • Mentor and guide junior SDETs, fostering a culture of quality and continuous learning
Nice to have
  • Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure)
  • Familiarity with MLOps pipelines and monitoring AI systems
  • Exposure to performance and scalability testing of AI workloads
EEO Statement

The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government recordkeeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision. We encourage you to review our Privacy Policy before submitting your application

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Software Development Engineer in Test - AI
Lead Software Development Engineer in Test - AI

HighLevel • United States

Remote
USD 180,000 - 240,000
Engineering Manager II, SDET
Engineering Manager II, SDET

HighLevel • United States

Remote
USD 180,000 - 240,000
Software Development Engineer in Test III - Core Modules
Software Development Engineer in Test III - Core Modules

HighLevel • United States

Remote
USD 27,000 - 43,000
Remote-first
Competitive salary
SDET with AI
SDET with AI

Synechron Technologies Pvt. Ltd._INDIA Company • Menlo Park (CA)

On-site
USD 110,000 - 115,000
Lead Software Development Engineer in Test - AI
Lead Software Development Engineer in Test - AI

HighLevel • Texas

Hybrid
USD 140,000 - 200,000
Senior AI SDET: Automate AI & RAG Testing
Senior AI SDET: Automate AI & RAG Testing

HighLevel • United States

Remote
USD 120,000 - 180,000
Sr. SDET
Sr. SDET

WillDom Global, LLC. • El Segundo (CA)

On-site
USD 140,000 - 210,000
Software Development Engineer in Test - AI
Software Development Engineer in Test - AI

Delos Data • Palo Alto (CA)

Hybrid
USD 140,000 - 220,000
Equity
Benefits package
401k
Lead Software Engineer In Test
Lead Software Engineer In Test

RapidCanvas • United States

Remote
USD 140,000 - 190,000
Senior QA Automation / SDET
Senior QA Automation / SDET

Marvik • United States

Remote
USD 100,000 - 160,000