AI Test Engineer II

Jobgether

Oregon

Hybrid

USD 125,000 - 150,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary
Comprehensive healthcare
401(k) with match
Parental leave
Fully remote
Professional development
Collaborative culture
Impactful work

Job summary

Jobgether is seeking an AI Test Engineer II in the United States to design, develop, and maintain automated testing across APIs, UI, and distributed systems. You will leverage AI tools to accelerate test creation, validate data integrity with SQL, and collaborate across Engineering, QA, Product, and Operations.

You will implement end-to-end and integration tests, focus on security and performance validation, and help advance testing practices in a healthcare technology context.

Qualifications

  • Experience with modern test automation frameworks.
  • Testing APIs, distributed systems, and data pipelines.
  • CI/CD pipeline integration experience.
  • Knowledge of security and performance testing.
  • Familiarity with AWS and cloud-based apps.

Responsibilities

  • Design, develop, and maintain automated test suites for APIs, UI, security, and performance.
  • Create end-to-end and integration tests for distributed environments.
  • Develop tests for REST and GraphQL services and validate contracts.
  • Leverage AI-assisted tools to generate and refactor tests.
  • Identify defects, drive root-cause analysis, and improve coverage.

Skills

Test automation
API testing
CI/CD
Agile
SQL validation
Security testing
Performance testing
Distributed systems
AWS familiarity

Education

Bachelor's degree or equivalent

Tools

Playwright
Cypress
Selenium
Claude Code
GitHub Copilot

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Test Engineer II based in the United States. As an AI Test Engineer II, you will play a key role in ensuring the quality, reliability, security, and performance of AI-powered applications and enterprise software systems. You will design, develop, and maintain automated testing solutions across APIs, user interfaces, integrations, and distributed systems. Working closely with Engineering, QA, Product, and Operations teams, you will help identify defects, prevent regressions, and strengthen overall product quality. You will also leverage AI-assisted development tools to accelerate test creation, improve automation workflows, and introduce innovative testing practices. In addition, you will contribute to security and performance validation, ensuring applications remain scalable and resilient. This is an exciting opportunity to work at the intersection of software quality engineering, artificial intelligence, and healthcare technology within a collaborative and fast-growing environment.

Accountabilities:
  • Test Automation and Engineering: Design, develop, and maintain automated test suites covering API, user interface, security, and performance testing. Build reliable, scalable, and maintainable automation frameworks that support continuous product validation.
  • End-to-End and Integration Testing: Develop end-to-end and integration tests using Playwright or comparable modern automation frameworks. Validate application workflows, system interactions, and integrations across distributed environments.
  • API Testing: Create and maintain automated tests for REST and GraphQL services, validating API contracts, error handling, edge cases, and expected system behavior.
  • AI-Assisted Testing: Leverage AI-powered coding and testing tools, such as Claude Code, GitHub Copilot, and similar solutions, to generate, refactor, and scale automated tests. Establish best practices for using AI assistants safely and effectively throughout the testing lifecycle.
  • Testing Innovation: Evaluate emerging AI-based testing technologies and identify opportunities to integrate useful tools into existing engineering workflows to improve productivity and test coverage.
  • Security and Performance Validation: Conduct security-focused testing covering authentication, authorization, input validation, and common OWASP vulnerabilities. Design and execute load and performance tests to assess scalability, response times, and system resilience under different workloads.
  • Defect Identification and Resolution: Identify performance bottlenecks, vulnerabilities, system failures, and other quality issues. Collaborate with engineering teams to investigate root causes and implement appropriate corrective actions.
  • Data and Integration Validation: Use SQL and data-validation techniques to verify data integrity across APIs, pipelines, and integrations. Test interactions between services and downstream systems while identifying anomalies, regressions, and gaps in end-to-end workflows.
  • CI/CD Integration: Integrate automated test suites into continuous integration and continuous delivery pipelines to enable consistent, automated quality checks throughout the software development lifecycle.
  • Cross-functional Collaboration: Work closely with Engineering, Quality Assurance, Product, and Operations teams to support sprint planning, backlog refinement, release validation, and ongoing product improvements.
  • Quality Standards and Documentation: Contribute to testing standards, automation best practices, technical documentation, and quality assurance processes. Participate in root cause analysis for defects and production incidents.
Requirements:
  • Bachelor's degree in Computer Science, Engineering, or a related technical discipline, or equivalent professional experience.
  • Previous professional experience in quality assurance automation, test engineering, software engineering, or a closely related role.
  • Hands-on experience with modern test automation frameworks, particularly Playwright. Experience with Cypress, Selenium, or comparable technologies is also valuable.
  • Demonstrated experience testing APIs, distributed systems, software integrations, and data pipelines.
  • Strong understanding of software testing principles, test automation architecture, and quality engineering methodologies.
  • Solid SQL knowledge and practical experience validating data integrity and consistency across complex systems.
  • Experience integrating automated testing solutions into CI/CD pipelines and supporting continuous delivery processes.
  • Familiarity with Agile software development methodologies, including sprint planning, backlog refinement, and release management.
  • Experience working with cloud-based applications and infrastructure, preferably within AWS environments.
  • Strong analytical and troubleshooting skills, with the ability to investigate system behavior, identify defects, and determine root causes.
  • Excellent communication and collaboration skills, with the ability to work effectively across technical and non-technical teams.
  • Ability to manage multiple testing priorities, demonstrate attention to detail, and take ownership of quality outcomes.
Preferred Qualifications:
  • Experience testing AI/ML models, intelligent applications, or data-driven software systems.
  • Familiarity with validating AI-generated outputs, prompt-based applications, and LLM-powered systems.
  • Understanding of large language models (LLMs), AI agent workflows, and AI-assisted software development.
  • Practical experience using AI-powered coding and testing tools such as Claude Code, GitHub Copilot, or similar platforms.
  • Experience with security testing and performance/load testing tools such as k6, JMeter, or OWASP ZAP.
  • Knowledge of DevOps practices, CI/CD automation, and modern software delivery pipelines.
  • Previous experience in healthcare technology or regulated-data environments, including familiarity with HIPAA and related compliance requirements.
  • General understanding of AI/ML concepts and their application in modern software environments.
Benefits:
  • Competitive annual salary: $125,000-$150,000, depending on experience, skills, and qualifications.
  • Comprehensive healthcare coverage: Access to highly valued health insurance benefits designed to support employees' wellbeing.
  • Retirement savings: 401(k) retirement plan with employer matching contributions.
  • Paid parental leave: Benefits designed to support employees and their families.
  • Remote working flexibility: Fully remote working arrangement offering flexibility and work-life balance.
  • Collaborative environment: Opportunity to join a growing, innovative organization that values teamwork, creativity, and continuous improvement.
  • Professional development: Opportunities to expand expertise in AI, software testing, automation, and healthcare technology.
  • Meaningful impact: Contribute to technology solutions that improve collaboration between healthcare payers and providers, reduce administrative waste, and support better access to healthcare.
Additional Information:
  • This is primarily a computer-based role performed in an indoor working environment, involving extended periods of sitting, typing, and using computer equipment.
  • The position requires sustained concentration, analytical thinking, and regular written and verbal communication.
  • Additional responsibilities or compliance-related requirements may be assigned according to business needs, potentially including background checks, drug screenings, and applicable information disclosures.
  • Reasonable accommodations may be provided to qualified individuals with disabilities to support the performance of essential job functions.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Test Engineer II
AI Test Engineer II

Trend Health Partners • Oregon

Hybrid
USD 125,000 - 150,000
Health insurance
401(k) with employer match
Paid parental leave
AI Test Engineer II
AI Test Engineer II

Trend Health Partners • United States

Remote
USD 125,000 - 150,000
Health insurance
401(k) with employer match
Paid parental leave
+1
AI Test Engineer III
AI Test Engineer III

Trend Health Partners • United States

Remote
USD 120,000 - 180,000
Health insurance
401(k) plan with employer match
Paid parental leave
Automation Test Engineer
Automation Test Engineer

Apt • Birmingham (AL)

On-site
USD 90,000 - 130,000
Quality Assurance Automation Engineer
Quality Assurance Automation Engineer

VetRamp • Dallas (TX)

Hybrid
USD 90,000 - 130,000
Employer-paid health insurance for you
Dental, vision, 401k and disability
Flexible remote/work-from-home options
+1
Senior Test Automation Engineer
Senior Test Automation Engineer

Metrosion Inc. • Burlingame (CA)

On-site
USD 140,000 - 190,000
Senior Test Engineer / QA Automation Engineer
Senior Test Engineer / QA Automation Engineer

Site • United States

On-site
EUR 55,000 - 85,000
Flexible engagement model
Challenging projects
Security compliance
+1
Senior AI-Assisted Test Automation Engineer
Senior AI-Assisted Test Automation Engineer

EPAM Systems • United States

Remote
USD 110,000 - 160,000
[Job - 32574] Senior QA Engineer — AI-Driven Testing, Brazil
[Job - 32574] Senior QA Engineer — AI-Driven Testing, Brazil

Ciandt • United States

Remote
USD 110,000 - 165,000
Health and dental insurance
Meal and food allowance
Childcare assistance
+10
AI Test Engineer II (Fully Remote)
AI Test Engineer II (Fully Remote)

TREND Health Partners • United States

Remote
USD 90,000 - 140,000
Remote-first environment
Comprehensive benefits package