Senior AI-Driven Test Automation Engineer

BlackCube Labs

United States

Remote

USD 120,000 - 180,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

Gramian Consultancy is seeking a Senior Test Automation Engineer to design and execute automated testing for AI-enabled applications. You will cover API testing, frontend automation, backend data flows, and system integration, including performance validation of critical components.

The role involves validating LLM prompts and outputs, ensuring accuracy and reducing hallucinations, and embedding tests into CI/CD pipelines.

Qualifications

  • 5–10 years of professional QA or test automation experience.
  • Hands-on with Selenium, Playwright, Cypress, and web/API testing.
  • Experience integrating automated tests into CI/CD pipelines.
  • Fluent English in professional settings.

Responsibilities

  • Design and maintain automated testing strategies across frontend, backend, APIs, and data flows.
  • Build and maintain automated test suites using Selenium, Playwright, Cypress or equivalents.
  • Develop tests for validating LLM prompts, model outputs, and hallucination behavior.
  • Perform system integration, regression, and end-to-end testing.
  • Conduct performance/load testing before production releases.
  • Ensure regression coverage stays current with evolving releases.
  • Collaborate with developers and platform teams to resolve issues.
  • Contribute to test standards and release-readiness criteria.

Skills

Selenium
Playwright
Cypress
API testing
Performance testing
CI/CD

Job description

Gramian Consultancy is seeking a Senior Test Automation Engineer to design and execute automated testing for AI-enabled applications. You will cover API testing, frontend automation, backend data flows, and system integration, including performance validation of critical components.

The role involves validating LLM prompts and outputs, ensuring accuracy and reducing hallucinations, and embedding tests into CI/CD pipelines.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Test & Evaluation Engineer
Senior AI Test & Evaluation Engineer

Motion • Birmingham (AL), Northern (KY)

Hybrid
USD 120,000 - 180,000
Senior AI-Driven Test Automation Engineer
Senior AI-Driven Test Automation Engineer

MyGeeksGuide Ltd • Long Beach (CA), Northern (KY)

Hybrid
USD 140,000 - 190,000
Software Test Engineer for AI Systems & Data Platforms
Software Test Engineer for AI Systems & Data Platforms

Apply • Northern (KY)

Hybrid
USD 110,000 - 160,000
Senior AI-Driven Test Automation Engineer
Senior AI-Driven Test Automation Engineer

Acentra Health • McLean (VA)

On-site
USD 104,000 - 130,000
GenAI Agentic Testing Engineer
GenAI Agentic Testing Engineer

Technology Ventures • McLean (VA)

On-site
USD 120,000 - 190,000
Senior AI Testing Engineer - Voice Tech & Data Platforms
Senior AI Testing Engineer - Voice Tech & Data Platforms

Deepgram • United States

Remote
USD 120,000 - 190,000
Senior AI-Driven Automation Tester (Remote)
Senior AI-Driven Automation Tester (Remote)

Reizend Private Limited • United States

Remote
USD 110,000 - 170,000
GenAI Test Automation Engineer
GenAI Test Automation Engineer

Veriipro • Tysons (VA)

On-site
USD 120,000 - 180,000
Quality Engineer, Tools and Automation
Quality Engineer, Tools and Automation

Socket.dev • Seattle (WA)

On-site
USD 140,000 - 210,000
Senior AI Test Automation Engineer
Senior AI Test Automation Engineer

Lean Solutions Group • Northern (KY)

Hybrid
USD 130,000 - 190,000