AI Quality Assurance Engineer

Tekskills Inc.; Delhi; In loco; INR 800.000 - 1.500.000; Tempo pieno

Descrizione del lavoro

Tekskills Inc. in Pune/Bangalore is hiring a detail-oriented AI Quality Assurance Engineer to join the AI Metadata Augmentation team. You will ensure the quality, accuracy, and reliability of AI/LLM outputs and work on cutting-edge AI systems deployed on AWS.

Responsibilities include designing LLM evaluation strategies, building automated tests in Python, performing prompt regression testing, and collaborating with AI engineers to debug edge cases and improve prompts.

Competenze

• Strong experience in QA Automation / Data Quality / Software Testing.
• Understanding of AI lifecycle (Training vs Inference, Prompt Engineering)
• Proficiency in Python for test automation and data validation
• Hands-on experience with JSON parsing and validation
• Basic knowledge of AWS (CloudWatch, S3)

Mansioni

• Design and execute LLM evaluation & benchmarking strategies (relevancy, consistency, metadata quality)
• Build and maintain automated testing frameworks using Python
• Perform prompt regression testing to track impact of changes over time
• Collaborate with AI engineers to debug edge cases and improve prompts/logic

Conoscenze

QA Automation

Python

JSON parsing

AI lifecycle

Data quality

Strumenti

AWS CloudWatch

Amazon S3

Descrizione del lavoro

Were Hiring: AI Quality Assurance Engineer(MetadataAugmentation)

Location: Pune / Bangalore

Experience: 4+ Years

We are looking for a detail-oriented AI QA Engineer to join our AI Metadata Augmentation team. If you are passionate about ensuring the quality, accuracy, and reliability of AI/LLM outputs, this is a great opportunity to work on cutting-edge AI systems deployed on AWS.

Key Responsibilities:

• Design and execute LLM evaluation & benchmarking strategies (relevancy, consistency, metadata quality)
• Build and maintain automated testing frameworks using Python
• Perform prompt regression testing to track impact of changes over time
• Collaborate with AI engineers to debug edge cases and improve prompts/logic

Required Skills & Experience:

• Strong experience in QA Automation / Data Quality / Software Testing
• Understanding of AI lifecycle (Training vs Inference, Prompt Engineering)
• Proficiency in Python for test automation and data validation
• Hands-on experience with JSON parsing and validation
• Basic knowledge of AWS (CloudWatch, S3)

#Hiring #AIJobs #QAEngineer #MachineLearning #LLM #PythonJobs #AWS #BangaloreJobs #PuneJobs #AIQA