AI Assurance Engineer

LTM; Pune District; Hybrid; INR 1,800,000 - 3,000,000; Full time

Job summary

LTM is seeking a Full Stack AI Assurance Engineer in Pune to design and develop test cases and evaluation datasets for LLM assessment using an AI Trust framework. You will analyze AIML datasets, perform model evaluation, and provide recommendations across data quality, bias, and governance.

The ideal candidate has strong AIML foundations, Python programming skills, and hands-on experience with prompt engineering and model classification.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering or related field.
• Minimum 5 years of experience in AIML, data science, software quality assurance or related domain.
• Hands-on experience with AI/ML data handling, model evaluation and assurance workflows.
• Strong understanding of AIML concepts, model lifecycle and data classification.

Responsibilities

• Identify data preparations for model evaluation and assess ethical, legal, safety and operational risks.
• Evaluate bias, fairness, transparency and robustness of AIML systems.
• Monitor data pipelines for data quality and representativeness for AIML models.
• Develop and execute validation plans for AIML models including performance and security testing.
• Implement tools to enhance interpretability and transparency of AI models.
• Work with data scientists, ML engineers and compliance teams to embed assurance practices.
• Set up monitoring for AI models in production and address drifts or policy violations.
• Contribute to AI governance frameworks and best practices.

Skills

AIML concepts

Python programming

prompt engineering

model classification

data classification

Copilot

Claude

Education

Bachelors or Masters in CS / Data Science

Tools

AWS

Azure

GCP

Copilot

Job description

Mandatory Skills :

• AI/GenAI Research, AI/ML Awareness Testing, AI/ML Testing

Required experience

• Full Stack AI Assurance Engineer to design develop the
• test cases with data sets for LLM Evaluation using AI Trust Assure framework and test AILLM evaluations and recommendations
• The ideal candidate will have a strong foundation in AIML concepts Python programming and RAGAS any equivalent frameworks along with hands-on experience in prompt engineering and models classification data classification

Key Responsibilities

• Identify and analyse the Data preparations for Model Evaluation specific to AIML systems including ethical legal safety security and operational risks
• Evaluate potential for bias unfairness lack of transparency and robustness etc
• Evaluate and monitor data pipelines to ensure high data quality integrity and representativeness for AIML models
• Develop and execute validation plans for AIML models including performance, robustness fairness and security testing
• Implement tools and practices to enhance the interpretability and transparency of AI models and outcomes
• Assess AI systems for ethical and fairness considerations and implement or recommend mitigation strategies as needed
• Set up and manage monitoring systems for AI models in production identifying and addressing drifts anomalies or policy violations
• Work closely with data scientists ML engineers compliance teams and
• business stakeholders to embed assurance practices throughout the AI lifecycle
• Contribute to the development and continuous improvement of AI governance frameworks and best practices
• Perform code reviews debugging and continuous improvement of automation pipelines
• Stay updated on emerging trends in AI ML and DL for AI Assurance

Required Skills

• Bachelors or Masters degree in Computer Science Data Science Engineering or a related field
• Minimum 5 years of experience in AIML data science software quality assurance or a related domain
• Hands on Exp in vibe coding such as Copilot Crewai Claude code
• Strong understanding of AIML concepts model classification and lifecycle
• Experience with risk management testing validation and monitoring of AI
• systems
• Experience with data quality assessment bias detection and fairness evaluation tools
• Familiarity with explainable AI XAI techniques and tools

Additional Skills

• Experience with Prompt Engineering LLM APIs and chatbot integration
• Knowledge of regulatory frameworks and standards for AI eg EU AI Act
• ISOIEC standards
• Knowledge of cloud environments AWS Azure or GCP
• Excellent analytical problem solving and documentation skills
• Strong analytical debugging and communication skills