QA Quality Engineer

Quantium; Hyderabad; On-site; INR 1,200,000 - 2,100,000; Full time

Benefits offered by this job

Hybrid work

Continuous learning

Health insurance

Supportive environment

Job summary

Quantium is pioneering data science and AI, seeking an engineer to elevate software quality through rigorous AI/LLM evaluations, test automation, and harness development. You will write production-grade tests, review changes, and help fold AI into delivery processes, while collaborating across squads.

You will work with tools like Deepeval, LangSmith, and modern testing frameworks, applying CI/CD practices and contributing to quality across the development lifecycle.

Qualifications

• Around 3–5 years building and testing software with AI fluency.
• Experience building or running evaluations for AI/LLM features, with test case walkthroughs.

Responsibilities

• Design and run evaluations for AI and LLM features, integrating into development workflow.
• Build or extend an AI harness for running systems against test cases and collecting scores.
• Design automated tests across the pipeline (unit, component, integration, end-to-end).
• Contribute to CI/CD quality gates and test strategy.
• Use agentic coding tools daily (e.g., Claude Code, Cursor, Copilot).

Skills

AI evaluation

Testing frameworks

JavaScript/TypeScript

Python for evaluation

CI/CD

Agentic coding tools

Code review

Tools

Deepeval

promptfoo

Braintrust

LangSmith

Cypress

Playwright

Selenium

Copilot

Job description

Who is Quantium?

Quantium is a world leader in data science and artificial intelligence. Established in Australia in 2002, Quantium is a global team of more than 1,200 people across 14 locations with a unique blend of capabilities across product and consulting services to help businesses unlock value from data and analytics. Quantium partners with the world's largest corporations to forge a better, more intelligent world.

How will you make an impact?

Build quality in with developers as part of the build phase, contributing to test strategy, automation and quality gates rather than testing after the fact.

Write production-quality code and review the code behind the changes under test, working as an engineer first and a quality specialist second.

Design and run evaluations for AI and LLM features, helping the team fold AI into how it delivers, using approaches such as LLM-as-judge and eval datasets.

Build or extend an AI harness - a named tool such as Deepeval, promptfoo, Braintrust or LangSmith, or a custom in-house framework - to run systems against test cases and collect scores in a repeatable way.

Design automated tests across the pipeline (unit, component, integration, end-to-end) and contribute to CI/CD quality gates.

Use agentic coding tools such as Claude Code, Cursor or Copilot as a daily habit in day-to-day build and test work.

Track meaningful quality signals, including risk-weighted coverage, escaped defects and test reliability.

Grow the team's quality mindset over time through patterns, documentation and coaching, enabling quality as a shared engineering responsibility across the squad.

The superpowers you'll be bringing to the team:

Core Experience

Around 3 to 5 years building and testing software, with engineering ability, AI fluency and evaluation experience weighted above years in role or a QA job title.

Practical, hands-on experience building or running evaluations for AI or LLM features, able to walk through the test cases, how outputs were scored, and what was learned.

Practical experience with an AI harness - a named tool (for example Deepeval, promptfoo, Braintrust, LangSmith) or a custom in-house framework - provided it is genuinely hands-on.

Daily use of agentic coding assistants such as Claude Code, Cursor or Copilot, with a concrete recent example of this in practice.

Coding skills at a developer's level in a modern language such as TypeScript or JavaScript, with Python valuable for evaluation and data work.

Practical experience with a modern testing framework (Cypress, Playwright, Selenium or similar) and automated test design.

CI/CD literacy and an understanding of how quality gates fit across the software development lifecycle.

Experience testing AI-consumed systems (agent or API interfaces, tool contracts, entitlements) as distinct from a UI is desirable.

Experience designing or extending automation frameworks, API and microservices testing, SQL and data fundamentals, and HTML/CSS selectors for UI automation is desirable.

Exhibits excellent judgement, striking the right balance between strategic thinking and tactical execution.

Excellent verbal and written communication skills; results-oriented with a demonstrated gets-done mindset and commitment to high standards.

What could your Quantium Experience look like?

Working at Quantium will allow you to challenge your imagination. You will get to solve complex problems using rigor, precision, and by asking great questions - but it also means you can think big, outside the box, and push your problem-solving skills to the max.

By joining the Quantium team, you'll get to:

• Forge your path: Shape your career journey with opportunities to move across different teams or offices
• Find your kind: Embrace diversity and connect with like-minded professionals
• Make an impact: Drive transformational outcomes for leading clients through data-driven, AI-powered solutions

Benefits and Perks:

• Flexible Work Arrangements: Achieve work-life balance with hybrid and flexible work arrangements
• Continuous Learning: Access to the Analytics Community, fostering development, thought leadership, and technical excellence through collaboration and best practice sharing
• Group and Health Insurance: Comprehensive coverage for you and your loved ones
• Supportive Environment: Modern, flexible, and supportive workplace dedicated to powering possibilities for our team members, clients, and partners

Quantium's recruitment process involves the collection and use of personal information. Please click on the link "Privacy" for Quantium's Collection Notice. This provides information on how we collect, use & store your personal information, including potential disclosure to our majority shareholder, Woolworths Group Limited.

Quantium's recruitment process involves the collection and use of personal information, see our Candidate Data Collection Notice for more information. T his provides information on how we collect, use & store your personal