QA Automation Engineer

Jobtailor; Town of Florida (NY); On-site; USD 90,000 - 120,000; Full time

Job summary

Jobtailor is seeking a QA engineer to design, develop, and maintain automated test frameworks for web, API, and integrated systems in a NY-based setup. You will review requirements to shape test scenarios, leverage AI-assisted design for efficiency, and execute diverse tests ensuring release readiness.

The role involves integrating tests into CI/CD pipelines, handling AI-generated artifacts, and working in regulated enterprise contexts.

Qualifications

• Experience in software quality assurance, including hands-on test automation development.
• Experience with test automation tools and frameworks.
• Experience integrating automated tests into CI/CD tools such as Azure DevOps, Jenkins, GitHub Actions or similar platforms preferred.
• Experience using generative AI or intelligent assistants to support test design, documentation, defect triage, or automation maintenance preferred.
• Experience testing enterprise applications, cloud-based platforms, or complex multi-system workflows preferred.
• Experience working in enterprise environments or regulated industries preferred.
• Proficiency in one or more programming or scripting languages.

Responsibilities

• Designs, develops, and maintains automated test frameworks and reusable scripts for web, API, and integrated systems.
• Reviews requirements to identify test scenarios, acceptance criteria, and automation opportunities.
• Uses AI-assisted tools to create and maintain test cases, data, and scripts.
• Executes regression, functional, smoke, integration, and API tests to validate quality and release readiness.
• Tests AI-powered applications and agents across prompts, scenarios, and edge cases for accuracy and reliability.
• Evaluates AI-generated outputs against expected results and identifies inaccuracies.

Skills

Test automation

CI/CD

AI-assisted testing

Scripting languages

Regulated environments

Education

Bachelor's degree or equivalent (CS/IT/Engineering)

Tools

Azure DevOps

Jenkins

GitHub Actions

Job description

Responsibilities

• Designs, develops, and maintains automated test frameworks and reusable scripts for web, API, and integrated systems
• Reviews business and technical requirements to identify test scenarios, acceptance criteria, automation opportunities, and where AI-assisted design can improve speed and coverage
• Uses AI-assisted tools to create and maintain test cases, data, and scripts, with appropriate review for accuracy and coverage
• Executes regression, functional, smoke, integration, and API tests to validate quality and release readiness
• Tests AI-powered applications and agents across prompts, scenarios, and edge cases to confirm accuracy, reliability, consistency, and expected behavior
• Evaluates AI-generated outputs against expected results and identifies inaccuracies, inconsistencies, or misleading responses
• Analyzes test results, investigates failures, documents defects, and uses AI-enabled insights to speed triage, root cause analysis, and retesting
• Integrates automated tests into CI/CD pipelines to provide fast, reliable feedback during builds and deployments
• Maintains test data, environments, automation assets, and AI-generated artifacts to support stable, repeatable, and auditable execution
• Tracks quality metrics such as coverage, defect trends, pass/fail rates, automation effectiveness, and the impact of AI-assisted testing
• Ensures AI use in testing complies with governance, data protection, and responsible AI standards
• Continuously improves automation frameworks, QA processes, and supporting tools to increase efficiency, governance, and overall effectiveness
• Creates and delivers presentations for technical, business, and leadership audiences
• Participates on camera in meetings with colleagues, business partners, and vendors when appropriate
• Performs other duties as assigned by the QA Manager

Requirements

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience
• Experience in software quality assurance, including hands‑on test automation development
• Experience with test automation tools and frameworks
• Experience integrating automated tests into CI/CD tools such as Azure DevOps, Jenkins, GitHub Actions, or similar platforms preferred
• Experience using generative AI or intelligent assistants to support test design, documentation, defect triage, or automation maintenance preferred
• Experience testing enterprise applications, cloud‑based platforms, or complex multi‑system workflows preferred
• Experience working in enterprise environments or regulated industries preferred
• Knowledge of performance, security, accessibility, or risk‑based testing practices preferred
• Proficiency in one or more programming or scripting languages.

Core Competencies

Demonstrates expertise in designing and maintaining automated test frameworks, utilizing AI‑assisted tools for test case creation, and integrating automated tests into CI/CD pipelines. Proficient in analyzing test results and ensuring compliance with governance and data protection standards.