AI Quality Assurance Engineer

Dassault Systèmes

Pune

On-site

INR 900,000 - 1,300,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Dassault Systèmes in Pune is hiring an AI Quality Assurance Engineer to validate AI-based applications with a focus on LLM testing, hallucination checks, and prompt validation. You will design comprehensive test plans, automate API and web services testing, and ensure quality across web and client-server platforms.

You will work with cross-functional and remote teams in an Agile POD, contributing to CI/CD integrations and applying AI-driven testing strategies.

Qualifications

  • BE/B.Tech/M.E/M.Tech required with 2–4 years of testing experience.
  • Hands-on AI/LLM testing experience and understanding of AI concepts.
  • Experience defining and implementing AI testing strategies (RAG, embeddings, prompts).
  • Experience with AI-assisted coding tools and testing methods.
  • Automation testing of Web Services/APIs and frameworks like Selenium/Playwright.
  • Willingness to learn new tools and in-house processes to meet global objectives.
  • Proficient in scripting language such as Java or Python.
  • Solid knowledge of SDLC/STLC processes and testing tools.
  • Ability to investigate failures, report defects, and provide metrics.

Responsibilities

  • Design, develop, and execute functional, integration, regression, and automation tests for AI-based apps.
  • Perform AI/LLM testing including hallucination checks and bias detection.
  • Evaluate RAG-based apps, embeddings, and LLM response accuracy.
  • Test AI agents, MCP integrations, and tool interactions.
  • Develop and maintain automation scripts for Web Services/APIs (Selenium/Playwright).
  • Investigate failed tests, report defects, and provide quality metrics to QA Manager.
  • Integrate AI model, prompt, and agent evaluations into CI/CD pipelines.
  • Collaborate with cross-functional/remote teams in an Agile POD setup.

Skills

AI testing
Automation testing
Team collaboration
Testing methodologies

Education

BE/B.Tech/M.E/M.Tech

Tools

Selenium
Playwright
CI/CD

Job description

Unlock your potential with Dassault Systèmes, a global leader in Scientific Software Engineering as an AI Quality Assurance Engineer in Pune, Maharashtra!
As an AI QA Engineer, you will be participating in Qualification of Web and/or Client-Server AI Applications. These Applications are used by our customers to design, develop, produce and market their Products and/or Services to end consumers. You will work directly with Product Define, Development, Testing, Project Management teams to ensure we are delivering high-quality, innovative products with an emphasis on innovation, speed to market and sustainability. You will lead in execution and team adoption of testing, automation tools & best practices.

  • Design, develop, and execute functional, integration, regression, and automation test cases for AI-based applications.
  • Perform AI/LLM application testing, including hallucination checks, bias detection, prompt validation, and responsible AI assessments.
  • Evaluate RAG-based applications, retrieval quality, embeddings, semantic similarity, and LLM response accuracy.
  • Test AI agents, MCP integrations, tool interactions, and non-deterministic agent responses.
  • Develop and maintain automation scripts for Web Services/APIs using frameworks such as Selenium and Playwright.
  • Investigate failed test cases and automation scripts, report defects, and provide defect and product quality metrics to the QA Manager.
  • Integrate AI model, prompt, and agent workflow evaluations into CI/CD pipelines.
  • Work closely with cross-functional and remote teams in an Agile/POD environment to ensure compliance with SQA standards and deliverable quality.
Qualifications
  • BE/B.Tech/M.E/M.Tech professional who has 2-4 years of experience in Manual and Automation Testing of AI based Software Applications involved in development and execution of functional, integration & regression tests of both Web and Client-Server Applications using best in class AI concepts and strategies.
  • Working Knowledge and hands-on experience in Core AI & LLM systems as user and tester
  • Experienced in define and implementation of various testing strategies for AI virtual assistants, RAG based applications.
  • Experience with using AI-assisted coding tools and methods
  • Automation Testing of Web Services/APIs’ & good understanding of its Automation Framework (like Selenium, Playwright).
  • Should have the motivation and ability to learn new Tools (including in-house ones), and Processes in order to deliver global objectives.
  • Experience in any of the scripting language like Java/Python is must.
  • Good Knowledge of SDLC/STLC Processes and Tools.
  • Investigate failed test cases/ automated scripts and report issues in defect tracking system, and provide Defect and Product metrics to QA Manager as appropriate.
  • Work closely with cross-functional teams to ensure project compliance with SQA standards and overall deliverable quality.
  • Work with remote teams in an agile/agile POD environment.
  • Knowledge/Experience of working in a DevOps/CI-CD Environment would be an added advantage.
  • Ability to communicate well, work as part of a team and interact effectively with others.

Displays initiative, self-motivation, and effective time-management skills.

What’s in it for you
  • Be at the forefront of building software products that are being deployed in mission-critical projects world wide
  • Be offered avenues to develop yourself for career progression
  • Not a low-level development opportunity, as you would get to work in the real business world and with a wide range of customers & coworkers
Inclusion statement

As a game-changer in sustainable technology and innovation, Dassault Systèmes is striving to build more inclusive and diverse teams across the globe. We believe that our people are our number one asset and we want all employees to feel empowered to bring their whole selves to work every day. It is our goal that our people feel a sense of pride and a passion for belonging. As a company leading change, it’s our responsibility to foster opportunities for all people to participate in a harmonized Workforce of the Future.

ENOVIA enables business and industry innovators to collaboratively build and execute a successful plan, transforming market opportunities into marketplace advantages.

Want to learn more?

Visit the other sections of our website to find out more.

Get to know about your recruitment journey.

Be part of the future of our workforce – check out internship and job opportunities.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Quality Assurance Engineer
AI Quality Assurance Engineer

Mployee.me • Pune

On-site
INR 700,000 - 1,100,000
AI QA Engineer
AI QA Engineer

Dassault Systèmes • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Senior AI QA Engineer (Pune )
Senior AI QA Engineer (Pune )

Money Forward India • Pune District

On-site
INR 2,800,000 - 4,000,000
Lead Software Development Engineer in Test - AI
Lead Software Development Engineer in Test - AI

Jobgether • India

Remote
INR 4,000,000 - 7,000,000
Fully remote (India)
Competitive salary
Leadership opportunities
+2
AI QA Engineer
AI QA Engineer

NewVision Software • Pune District

Hybrid
INR 1,200,000 - 1,800,000
Quality Assurance Engineer – AI Agentic Applications, AVP
Quality Assurance Engineer – AI Agentic Applications, AVP

Deutsche Bank AG • Pune District

On-site
INR 1,500,000 - 2,700,000
Best in class leave policy
Gender neutral parental leaves
Sponsorship for industry certs
Multibody Dynamics Testing Engineer
Multibody Dynamics Testing Engineer

Dassault Systèmes • Pune District

On-site
INR 420,000 - 640,000
AI Senior QA
AI Senior QA

Hiver, Inc. • Bengaluru

On-site
INR 2,200,000 - 3,400,000
QA Architect
QA Architect

Psiog Digital • Chennai

On-site
INR 1,800,000 - 3,200,000
QA Engineer(AI)
QA Engineer(AI)

National e-Governance Division • New Delhi

On-site
INR 3,500,000 - 5,000,000