AI Assurance Engineer

LTM; Hyderabad; Hybrid; INR 1,800,000 - 2,800,000; Full time

Job summary

LTM in Hyderabad, India is seeking a Full Stack AI Assurance Engineer to design test cases for LLM evaluation using the AI Trust Assure framework and to perform AI/ML testing across datasets. Strong Python, AIML concepts and prompt engineering are required.

The role emphasizes data quality, bias detection, risk management and governance, with collaboration from data scientists, ML engineers, and compliance teams to embed assurance throughout the AI lifecycle.

Qualifications

• Bachelor's or master's degree in CS/DS/Engineering or related field
• Minimum 5 years of experience in AIML, data science, software quality assurance or related domain
• Hands-on experience with prompt engineering and model classification/data classification
• Strong understanding of AIML concepts, model lifecycle and data quality assessment

Responsibilities

• Identify and analyse data preparations for model evaluation including ethical, legal, safety, security and operational risks
• Evaluate bias, unfairness, lack of transparency and robustness concerns
• Monitor data pipelines to ensure data quality, integrity and representativeness for AIML models
• Develop and execute validation plans for AIML models focusing on performance, robustness, fairness and security
• Implement tools to enhance interpretability and transparency of AI models
• Assess AI systems for ethical considerations and mitigation strategies
• Set up monitoring systems for AI models in production to detect drifts and policy violations
• Collaborate with data scientists, ML engineers, compliance teams and business stakeholders to embed assurance across the AI lifecycle
• Contribute to AI governance frameworks and best practices
• Perform code reviews, debugging and improve automation pipelines
• Stay updated on AI/ML/DL trends for AI Assurance

Skills

AI/GenAI Research

AI/ML Awareness Testing

AI/ML Testing

Education

Bachelors or Masters in Computer Science / Data Science / Engineering

Tools

Copilot

Claude

Job description

Mandatory Skills : AI/GenAI Research, AI/ML Awareness Testing, AI/ML Testing

Required experience

Full Stack AI Assurance Engineer to design develop the

test cases with data sets for LLM Evaluation using AI Trust Assure framework and test AILLM evaluations and recommendations

The ideal candidate will have a strong foundation in AIML concepts Python programming and RAGAS any equivalent frameworks along with handson experience in prompt engineering and models classification data classification

Key Responsibilities

Identify and analyse the Data preparations for Model Evaluation specific to AIML systems including ethical legal safety security and operational risks and

Evaluate potential for bias unfairness lack of transparency and robustness etc

Evaluate and monitor data pipelines to ensure high data quality integrity and representativeness for AIML models

Develop and execute validation plans for AIML models including performance, robustness fairness and security testing

Implement tools and practices to enhance the interpretability and transparency of AI models and outcomes

Assess AI systems for ethical and fairness considerations and implement or recommend mitigation strategies as needed

Set up and manage monitoring systems for AI models in production identifying and addressing drifts anomalies or policy violations

Work closely with data scientists ML engineers compliance teams and

business stakeholders to embed assurance practices throughout the AI lifecycle

Contribute to the development and continuous improvement of AI governance frameworks and best practices

Perform code reviews debugging and continuous improvement of automation pipelines

Stay updated on emerging trends in AI ML and DL for AI Assurance

Required Skills

Bachelors or Masters degree in Computer Science Data Science Engineering

or a related field

Minimum 5 years of experience in AIML data science software quality assurance or a related domain

Hands on Exp in vibe coding such as Copilot Crewai Claude code

Strong understanding of AIML concepts model classification and lifecycle

Experience with risk management testing validation and monitoring of AI

systems

Experience with data quality assessment bias detection and fairness evaluation tools

Familiarity with explainable AI XAI techniques and tools

Additional Skills

Experience with Prompt Engineering LLM APIs and chatbot integration

Knowledge of regulatory frameworks and standards for AI eg EU AI Act

ISOIEC standards

Knowledge of cloud environments AWS Azure or GCP

Excellent analytical problemsolving and documentation skills

Strong analytical debugging and communication skills