Director – QA & Testing (P&C Insurtech)

Crystal Peak; Dadri; Presencial; INR 3.000.000 - 5.000.000; Jornada completa

Descripción de la vacante

Crystal Peak in Noida, India, seeks a visionary leader to head Quality Assurance and Testing within our AI/Data Center of Excellence. You will shape QA strategy across traditional software, data, and AI-driven systems, ensuring reliability, performance, and regulatory compliance.

You will define AI evaluation frameworks, drive test automation, collaborate with MLOps and data teams, and mentor a high-performing QA organization focused on AI applications, automation, and production quality.

Formación

• Bachelor’s or Master’s degree in CS, IT, or a related technical discipline.
• Experience leading enterprise-scale QA functions including AI/ML systems.
• Expertise in test automation, performance testing, CI/CD integration, and AI model quality engineering.

Responsabilidades

• Lead QA strategy across software, data, and AI-driven systems.
• Define AI evaluation frameworks for model accuracy, fairness, and bias detection.
• Drive automation-first testing with AI-powered tools.
• Collaborate with MLOps and data teams for continuous testing.
• Establish governance and compliance for AI and data systems.
• Partner with cross-functional teams to integrate testing early in development.
• Evaluate and deploy AI-based testing solutions.
• Mentor and grow a high-performing QA/testing organization.
• Ensure performance, reliability, and SLAs for AI systems.
• Engage stakeholders to drive quality culture and risk mitigation.

Conocimientos

QA Leadership

AI Testing

Test Automation

MLOps

Data Quality

Governance & Compliance

Stakeholder Communication

Educación

Bachelor’s/Master’s in CS/IT

Herramientas

Selenium

PyTest

Robot Framework

Postman

JMeter

TensorBoard

LangSmith

AI Eval frameworks

Descripción del empleo

Role: Lead the Quality Assurance and Testing organization within the AI/Data Center of Excellence (CoE), ensuring delivery of reliable, high-performing, and compliant AI and data-driven systems across the enterprise.

Location: Noida, India

Key Responsibilities:

• Quality & Testing Leadership: Establish and lead comprehensive QA strategy across traditional software, data, and AI-driven systems in alignment with enterprise digital transformation goals.
• AI Evaluations: Define frameworks and metrics for AI/ML testing—covering model accuracy, robustness, fairness, explainability, and bias detection. Develop automated evaluation pipelines for LLMs and AI applications.
• Test Automation & Innovation: Drive automation-first strategy using AI-powered testing tools to improve speed, accuracy, and coverage across regression, performance, and integration testing.
• MLOps & Data Quality: Collaborate with MLOps and data engineering teams to ensure model validation, monitoring, and continuous testing of data pipelines and ML workflows.
• Governance & Compliance: Establish quality governance processes for AI and data systems adhering to internal standards, industry best practices, and regulatory requirements for P&C insurance operations.
• Cross-Functional Collaboration: Partner with AI architects, data scientists, software engineers, underwriters, and claims teams to integrate testing early in development and ensure reliable deployment.
• AI-in-QA Enablement: Evaluate and deploy AI-based testing solutions, including intelligent defect prediction, test case generation, and anomaly detection in production systems.
• Team Development: Build and mentor a high-performing QA/testing organization specializing in AI applications, automation, and performance testing.
• Performance & Reliability: Ensure AI systems and digital applications meet SLAs for scalability, reliability, interpretability, and compliance.
• Stakeholder Management: Collaborate with business, technology, and innovation leaders to drive quality culture, risk mitigation, and continuous improvement.

Required Qualifications:

• Education: Bachelor’s/Master’s degree in Computer Science, Information Technology, or related technical discipline.
• Experience: 12+ years of QA/Testing experience with 5+ years in teams accountability too; proven track record in managing enterprise-scale QA functions, including testing of AI/ML systems.
• Technical Skills: Expertise in test automation frameworks, performance testing, CI/CD integration, and quality engineering of AI models and APIs.
• AI Testing Expertise: Experience designing AI evaluation strategies for LLMs, NLP systems, computer vision, or predictive models, including use of benchmarks and bias/fairness tools.
• Tools & Platforms: Proficiency with tools like Selenium, PyTest, Robot Framework, Postman, JMeter, TensorBoard, and AI Eval frameworks (e.g., PromptBench, DeepEval, LangSmith).
• Insurance Domain: Understanding of Property & Casualty (P&C) insurance workflows including underwriting, claims, and policy management is preferred.
• Governance & Compliance: Familiarity with ISO, SOC2, and model validation standards for AI assurance.
• Communication: Strong ability to communicate technical quality concepts to executive and non-technical stakeholders

Preferred Qualifications:

• Insurance & AI: Experience testing AI applications in P&C insurance domain, including underwriting automation, claims triage, and telematics.
• AI in QA: Proven experience integrating AI tools for intelligent automation, defect analysis, and test optimization.
• Leadership: Strong team-building, mentorship, and stakeholder engagement experience in global organizations.
• Innovation Focus: Background in developing next-generation QA frameworks for digital transformation and AI assurance