AI Tester - Senior QA Automation Engineer (Selenium & AI Testing)

MDA Edge; Jersey City (NJ); On-site; Full time

Job summary

MDA Edge is looking for a Senior QA Automation Engineer to lead system integration testing and develop automated testing frameworks. The ideal candidate will have over 6 years of experience in Software Functional Testing, expertise in Selenium, and proficiency in AI testing methodologies. This full-time role offers an opportunity to work on innovative AI projects in a collaborative environment.

Qualifications

• 6+ years of experience in Software Functional Testing.
• Expertise in Selenium for test automation.
• Proficiency in Python and AI testing frameworks.

Responsibilities

• Lead system integration testing and ensure quality standards.
• Develop automated tests using Selenium and other tools.
• Perform AI-specific testing including validation of LLMs.

Skills

Software Functional Testing

Selenium

Python

SQL querying

AI testing frameworks

Communication

Leadership

Tools

Jira

ALM

Snowflake

Pytest

PyTorch

LangChain

Job description

Get AI-powered advice on this job and more exclusive features.

This range is provided by MDA Edge. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$45.00/hr - $50.00/hr

Job Summary:

We are seeking a highly skilled Senior QA Automation Engineer with 6+ years of experience in Software Functional Testing and 4–7 years of expertise in Selenium. The ideal candidate will lead system integration testing, ensure adherence to quality standards, and develop AI-specific automated testing frameworks. This role requires expertise in Agile methodologies, test automation tools, and AI model evaluation using LLMs and RAG architectures.

Key Responsibilities:

• Conduct system integration testing for new and enhanced applications.
• Develop and execute automated tests using Selenium and other industry-standard tools.
• Collaborate with project teams to establish plans, standards, and procedures that optimize testing efforts.
• Ensure on-time delivery by monitoring dependencies, progress, and milestones.
• Educate business and development teams on the testing methodology, with a focus on end-to-end quality assurance.
• Lead project and quality management initiatives, including issue tracking and communication.
• Optimize resource utilization by assisting the Testing Manager in reviewing forecasting reports.
• Ensure compliance with Agile methodologies, maintaining detailed process documentation.
• Perform AI-specific testing, including validation of LLMs and RAG architectures using vector databases.
• Implement automated testing frameworks for Gen AI applications, such as DeepEval and RAGAs.
• Develop custom validation scripts for evaluating AI model accuracy, relevance, and faithfulness.
• Test prompt engineering techniques to refine AI-generated responses.
• Execute SQL queries in Snowflake to validate database integrity and application responses.

Essential Skills & Experience:

• 6+ years of experience in Software Functional Testing with automation expertise in Selenium.
• Experience with Jira and ALM for test and issue tracking.
• Strong proficiency in Python, with experience in AI testing frameworks such as LangChain, Pytest, and PyTorch.
• Hands-on expertise in LLM & RAG architecture testing using vector databases.
• Familiarity with Snowflake, SQL querying, and data validation techniques.
• Excellent communication and leadership skills to engage with stakeholders.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Other

Industries

• IT Services and IT Consulting

Referrals increase your chances of interviewing at MDA Edge by 2x

Get notified about new Senior Quality Assurance Tester jobs in Jersey City, NJ.

Other related jobs in New York, NY, with salary details and posting dates, are also listed for your reference.