Associate Lead - Testing (QA + MLOps)

Quantiphi, Inc.; Mumbai; On-site; INR 3,500,000 - 6,500,000; Full time

Job summary

A technology solutions provider is seeking a Lead/Associate Lead in QA focusing on MLOps and Generative AI in Mumbai/Bangalore. The role requires 10+ years of experience in Quality Engineering, strong communication skills, and expertise in AI/ML testing. You will lead QA teams, implement test strategies, and work with modern tools like AWS and various ML libraries. Enjoy opportunities to learn and grow in a diverse hybrid work culture.

Qualifications

• 10+ years of experience in Quality Engineering.
• Experience in leading QA transformation initiatives.
• Hands-on experience validating ML models.
• Hands-on ML lifecycle experience; testing ML models, NLP preferred, validating LLM apps.
• Deep knowledge of prompt engineering, RAG, embeddings, bias and explainability.

Responsibilities

• Lead QA teams in delivering high-quality products.
• Create strategies and solution proposals.
• Implement automation testing frameworks.

Skills

Test strategy

Automation

Governance experience

ML lifecycle understanding

NLP testing

AWS AI/ML services

Communication skills

Stakeholder management

LLM Testing

API Testing

Git Workflows

Leadership

Stakeholder Mgmt

Tools

Amazon SageMaker

TensorFlow

PyTorch

Scikit-learn

CloudWatch

CodePipeline

CodeBuild

LangChain

TensorFlow

PyTorch

Scikit-learn

Job description

****Role:** Lead/Associate Lead – QA + MLOps & Generative AI******Experience:** 10+ years******Location:** Mumbai/Bangalore (Hybrid)*** **8–12+ years in Quality Engineering*** **Strong test strategy, automation & governance experience*** **Experience leading QA transformation initiatives*** **Experience building frameworks from scratch** ****AI/ML & GenAI Expertise***** **Deep understanding of ML lifecycle*** **Experience testing ML models (NLP preferred)*** **Hands-on experience validating LLM applications*** **Strong understanding of:*** **Prompt engineering*** **RAG architecture*** **Embeddings*** **Bias & explainability** ****AWS AI/ML Expertise***** **Hands-on experience with:*** **Amazon SageMaker (training, deployment, monitoring)*** **Amazon Bedrock (LLM integration & evaluation)*** **S3-based data pipelines*** **AWS IAM (security validation)*** **CloudWatch monitoring*** **Lambda & API Gateway integrations*** **AWS CI/CD (CodePipeline / CodeBuild preferred)*** **Python (mandatory)*** **Experience with ML libraries (Scikit-learn, TensorFlow, PyTorch)*** **Experience with LLM frameworks (LangChain, etc.)*** **API & automation testing frameworks*** **Git-based workflows*** **Leadership & Communication*** **Strong client-facing communication*** **Experience leading QA teams*** **Ability to create strategy decks & solution proposals*** **Strong stakeholder management**Thank you for your interest in Quantiphi! We are a team that dreams together and collaborates to ensure success. We are currently looking for exceptional individuals who can join us and contribute to a fun, diverse and hybrid work culture. As a part of the Quantiphi family, you will get ample opportunities to learn, grow and interact with colleagues from varied experience and backgrounds around the globe. If this excites you, explore our current openings and apply to any job roles that suit and interest you.