AI Testing

LTM

Chennai

Hybrid

INR 1,500,000 - 2,100,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

LTM is seeking a Full Stack AI Assurance Engineer to design and develop test cases with data sets for LLM evaluation using the AI Trust Assure framework. You will test AILLM evaluations and provide recommendations, grounding your work in Python and AIML concepts.

You will collaborate with data scientists, ML engineers, and compliance to embed assurance practices across the AI lifecycle and drive governance improvements.

Qualifications

  • Bachelor's or Master’s degree in Computer Science, Data Science, Engineering or related field.
  • Minimum 5 years of experience in AIML, data science, software quality assurance, or related domain.
  • Hands-on experience with coding tools such as Copilot, Crewai, Claude.
  • Strong understanding of AIML concepts, model classification, and lifecycle.
  • Experience with risk management, testing, validation, and monitoring of AI systems.
  • Experience with data quality assessment, bias detection and fairness evaluation tools.
  • Familiarity with explainable AI (XAI) techniques and tools.

Responsibilities

  • Identify and analyse data preparations for model evaluation, considering ethical, legal, safety, security and operational risks.
  • Evaluate bias, unfairness, transparency and robustness of AI systems.
  • Monitor data pipelines for quality, integrity, and representativeness for AIML models.
  • Develop and execute validation plans for AIML models, including performance and security testing.
  • Implement tools to enhance interpretability and transparency of AI models and outcomes.
  • Embed AI governance practices across the lifecycle with stakeholders.

Skills

AIML concepts
Python programming
Prompt engineering
Model classification
Data quality
Explainable AI
Lifecycle management
Risk monitoring
Communication skills

Education

Bachelors or Masters in CS/DS
MSc in CS/DS

Tools

Copilot
Crewai
Claude
AI Trust Assure

Job description

Mandatory Skills :

AI/GenAI Research, AI/ML Awareness Testing, AI/ML Testing

Required experience

Full Stack AI Assurance Engineer to design develop the test cases with data sets for LLM Evaluation using AI Trust Assure framework and test AILLM evaluations and recommendations

The ideal candidate will have a strong foundation in AIML concepts Python programming and RAGAS any equivalent frameworks along with hands-on experience in prompt engineering and models classification data classification

Key Responsibilities
  • Identify and analyse the Data preparations for Model Evaluation specific to AIML systems including ethical legal safety security and operational risks
  • Evaluate potential for bias unfairness lack of transparency and robustness etc
  • Evaluate and monitor data pipelines to ensure high data quality integrity and representativeness for AIML models
  • Develop and execute validation plans for AIML models including performance, robustness fairness and security testing
  • Implement tools and practices to enhance the interpretability and transparency of AI models and outcomes
  • Assess AI systems for ethical and fairness considerations and implement or recommend mitigation strategies as needed
  • Set up and manage monitoring systems for AI models in production identifying and addressing drifts anomalies or policy violations
  • Work closely with data scientists ML engineers compliance teams and business stakeholders to embed assurance practices throughout the AI lifecycle
  • Contribute to the development and continuous improvement of AI governance frameworks and best practices
  • Perform code reviews debugging and continuous improvement of automation pipelines
  • Stay updated on emerging trends in AI ML and DL for AI Assurance
Required Skills
  • Bachelors or Masters degree in Computer Science Data Science Engineering or a related field
  • Minimum 5 years of experience in AIML data science software quality assurance or a related domain
  • Hands on Exp in vibe coding such as Copilot Crewai Claude code
  • Strong understanding of AIML concepts model classification and lifecycle
  • Experience with risk management testing validation and monitoring of AI systems
  • Experience with data quality assessment bias detection and fairness evaluation tools
  • Familiarity with explainable AI XAI techniques and tools
Additional Skills
  • Experience with Prompt Engineering LLM APIs and chatbot integration
  • Knowledge of regulatory frameworks and standards for AI eg EU AI Act
  • ISOIEC standards
  • Knowledge of cloud environments AWS Azure or GCP
  • Excellent analytical problem solving and documentation skills
  • Strong analytical debugging and communication skills
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Test Engineer
AI Test Engineer

AXA Global Business Services (AXA GBS) • Pune District

On-site
INR 900,000 - 1,500,000
Test Analyst - AI Assurance
Test Analyst - AI Assurance

Hexaware Technologies Limited • India

On-site
INR 4,500,000 - 7,500,000
AI or ML Engineer - Python, QA Testing
AI or ML Engineer - Python, QA Testing

Optum • Hyderabad

On-site
INR 1,800,000 - 3,200,000
AI - Software Development Engineer in Test (AI - SDET)
AI - Software Development Engineer in Test (AI - SDET)

Mployee.me • Mumbai

On-site
INR 1,200,000 - 1,800,000
Senior Software Quality Engineer - AI Assurance
Senior Software Quality Engineer - AI Assurance

Sysvine Technologies Private Limited. • Chennai

On-site
INR 2,000,000 - 3,500,000
AI Trust and Governance Architect
AI Trust and Governance Architect

Infosys • Bengaluru

On-site
INR 1,600,000 - 2,400,000
AI Test Engineer
AI Test Engineer

Deqode • Bengaluru

On-site
INR 900,000 - 1,500,000
AI QA Engineer
AI QA Engineer

Mployee.me • Delhi

On-site
INR 1,500,000 - 2,800,000
AI QA Engineer
AI QA Engineer

NewVision Software • Pune District

Hybrid
INR 1,200,000 - 1,800,000
AI/ML Quality & Automation Engineer (GenAI & Agentic Systems)
AI/ML Quality & Automation Engineer (GenAI & Agentic Systems)

Virtusa Corporation • Hyderabad, Chennai, Bengaluru

Hybrid
INR 900,000 - 1,300,000