QA Engineer

Sutherland

Chennai District

On-site

INR 1,200,000 - 2,400,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Sutherland India seeks an experienced QA/test engineer to own testing of agent outputs, ensuring accuracy and monitoring regression as ML/LLM systems evolve. You will design test data, define accuracy benchmarks, and collaborate with human QA to validate regulated processes using golden-record datasets.

You will work across document/text-processing scenarios, with a focus on delivering reliable, audit-ready results and preventing drift in production systems.

Qualifications

  • 5+ years QA/test engineering experience, ideally including ML/LLM output validation.
  • Experience defining test datasets and accuracy benchmarks for document/text-processing systems.
  • Domain process familiarity a plus for building realistic test scenarios.

Responsibilities

  • Owns technical testing of agent outputs — accuracy, turnaround-time impact, and regression testing as agents are iterated.
  • Build test suites validating agent outputs against golden-record datasets across covered processes.
  • Track and report accuracy/turnaround-time metrics to support baselining exercises agreed with the business.
  • Run regression testing whenever agent/prompt configurations change, to prevent silent accuracy drift in regulated processes.
  • Feed findings into the human QA function for final sign-off — this role supports human QA authority on regulated activity with technical evidence, not replaces it.

Skills

QA testing
ML/LLM validation
Regression testing

Job description

Artificial Intelligence. Automation.Cloud engineering. Advanced analytics.For business leaders, these are key factors of success. For us, they’re our core expertise.

We work with iconic brands worldwide. We bring them a unique value proposition through market-leading technology and business process excellence.

We’ve created over 200 unique inventions under several patents across AI and other critical technologies. Leveraging our advanced products and platforms, we drive digital transformation, optimize critical business operations, reinvent experiences, and pioneer new solutions, all provided through a seamless “as a service” model.

For each company, we provide new keys for their businesses, the people they work with, and the customers they serve. We tailor proven and rapid formulas, to fit their unique DNA.We bring together human expertise and artificial intelligence to develop digital chemistry. This unlocks new possibilities, transformative outcomes and enduring relationships.
Sutherland

Job Description

Role Summary

Owns technical testing of agent outputs — accuracy, turnaround-time impact, and regression testing as agents are iterated — feeding the accuracy and completion-time KPIs tracked at the programme level.

Key Responsibilities

  • Build test suites validating agent outputs against golden-record datasets across covered processes.
  • Track and report accuracy/turnaround-time metrics to support baselining exercises agreed with the business.
  • Run regression testing whenever agent/prompt configurations change, to prevent silent accuracy drift in regulated processes.
  • Feed findings into the human QA function for final sign-off — this role supports human QA authority on regulated activity with technical evidence, not replaces it.
Qualifications

Required Experience

  • 5+ years QA/test engineering experience, ideally including ML/LLM output validation (not just deterministic software testing).
  • Experience defining test datasets and accuracy benchmarks for document/text-processing systems.
  • Domain process familiarity a plus for building realistic test scenarios.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

QA Engineer – Automation & Agentic Applications
QA Engineer – Automation & Agentic Applications

Beroe Inc • India

On-site
INR 1,000,000 - 1,500,000
Senior QA Engineer, AI
Senior QA Engineer, AI

Intercontinental Exchange Holdings, Inc. • Hyderabad

On-site
INR 2,000,000 - 4,000,000
Senior QA Engineer, AI
Senior QA Engineer, AI

ICE • Hyderabad

On-site
INR 1,800,000 - 3,000,000
QA Engineer / Senior QA Engineer – GenAI Testing-PL
QA Engineer / Senior QA Engineer – GenAI Testing-PL

Iassess Consultants • Bengaluru

On-site
INR 900,000 - 1,300,000
AI QA Engineer
AI QA Engineer

Channel Fusion North America • Chandigarh

On-site
INR 1,200,000 - 2,400,000
Test Lead - AI Agent Testing
Test Lead - AI Agent Testing

Hexaware Technologies Limited • Pune District, Chennai, Bengaluru

Hybrid
INR 1,500,000 - 2,100,000
Artificial Intelligence Engineer
Artificial Intelligence Engineer

Optum • Hyderabad

Hybrid
INR 1,500,000 - 2,100,000
AI Quality Engineer
AI Quality Engineer

Marlabs Inc. • Bengaluru, Pune District

On-site
INR 1,500,000 - 2,100,000
QA Engineer
QA Engineer

TigerHire • India

Remote
INR 1,200,000 - 2,000,000
QA Engineer
QA Engineer

Beam AI • Dadri

On-site
INR 6,673,000 - 10,486,000