Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
New Vision Softcom & Consultancy Pvt. Ltd is seeking an AI Test Engineer to validate quality, reliability and safety of AI systems, including LLMs, RAG pipelines and AI agents. You will design evaluation datasets, prompts and benchmarks, and drive automated testing within CI/CD pipelines.
The role focuses on prompt behavior, risk management and governance, with hands-on work in Python, Pytest, Java, Selenium and Playwright, plus Azure AI Services. Hybrid Pune-based office preferred.
Company Name New Vision Softcom & Consultancy Pvt. Ltd
Function Business Units (BU)
Department/Practice Digital Assurance
Organization Unit Technology Assurance / Automation
Region APAC
Country India
Base office location Pune
Working model Hybrid
Weekly Off Pune office Standard
State Maharashtra
The AI Test Engineer is responsible for validating the quality, reliability, safety, performance, and governance of AI systems, including LLMs, RAG pipelines, and AI agents. Unlike traditional QA role, this position focuses on LLM evaluation, behavioral testing, hallucination, bias detection, AI test automation, and alignment with Responsible AI governance standards.
Key Responsibilities:
Qualifications: