Assure AI Engineer

Zensar Technologies; Bengaluru; On-site; INR 3,000,000 - 5,500,000; Full time

Job summary

Zensar Technologies is seeking two Gemini – AssureAI Engineers to operate the Trustworthiness evaluation suites for GenAI agents. You will run bias and red-team testing, ensure explainability, and integrate tests into CI/CD pipelines while coordinating with AI engineers and governance teams.

The role focuses on building evaluation datasets, maintaining provenance, and scaling evaluation across multiple agent domains as the platform expands within the AssureAI program.

Qualifications

• Hands-on QA/test engineering for ML/GenAI systems with eval framework experience.
• Experience with AssureAI or comparable AI-evaluation platform.
• Knowledge of bias/fairness testing and explainability techniques.

Responsibilities

• Build and maintain evaluation datasets and scenarios for Trustworthiness checks as new agents come online.
• Run bias, toxicity, red-team, and explainability test suites; triage failures to the appropriate owner.
• Maintain the CI/CD threshold-gate configuration to block releases on failing checks.
• Package audit evidence and provenance for CSG review-board submissions.
• Track dataset coverage and flag gaps as agent scope expands into new domains.
• Split coverage across two engineers to scale evaluation throughput.

Skills

Python

QA / ML Testing

ML Evaluation

CI / CD

Bias Testing

Explainability (SHAP/LIME)

Adversarial Testing

Tools

DeepEval

Ragas

Promptfoo

Job description

About The Role

You are one of two hands‑on operators of AssureAI's Trustworthiness pillar inside the Governance Control Tower. Where the AI Trust & Compliance Engineer sets the strategy - which regulations map to which checks, what a passing threshold means - you build and run the evaluation suites that prove it, day in and day out, across a growing roster of Gemini-based agents. You report to the AI Trust & Compliance Engineer and work closely with the AI Engineers building the agents you test.

Job Description

Gemini – AssureAI Engineer

2 positions

Keywords: AssureAI

• Evaluation Datasets
• Red-Teaming
• Bias & Explainability (SHAP/LIME)
• Threshold Gates
• CI/CD
• Audit Evidence
• Python

About The Role

You are one of two hands‑on operators of AssureAI's Trustworthiness pillar inside the Governance Control Tower. Where the AI Trust & Compliance Engineer sets the strategy - which regulations map to which checks, what a passing threshold means - you build and run the evaluation suites that prove it, day in and day out, across a growing roster of Gemini-based agents. You report to the AI Trust & Compliance Engineer and work closely with the AI Engineers building the agents you test.

What You'll Own

• Build and maintain evaluation datasets and scenarios for each of AssureAI's 19 Trustworthiness checks (explainability, audit provenance, regulation coverage, safety guardrails) as new agents come online.
• Run scheduled and on-commit bias, toxicity, red-team, and explainability (SHAP/LIME) suites; triage failures and route them to the right owner (AI Engineer, Integration Specialist, or Governance Engineer).
• Maintain the CI/CD threshold-gate configuration so a failing Trustworthiness check blocks release rather than just flagging it.
• Package audit evidence - run provenance, evidence exportability, regulation-coverage reports - for the AI Trust & Compliance Engineer's CSG review-board submissions.
• Track dataset coverage and flag gaps as agent scope expands into new domains, data types, or regulatory contexts.
• Split coverage with the second AssureAI Engineer across agent domains or pipeline stages so evaluation throughput scales with agent count.

What We're Looking For

• 5-7 years in QA/test engineering for ML or GenAI systems, ideally with a dedicated eval framework (DeepEval, Ragas, Promptfoo, or comparable).
• Hands-on experience with AssureAI or a directly comparable AI-assurance/evaluation platform.
• Working knowledge of bias/fairness testing, explainability techniques (SHAP/LIME), and red-teaming/adversarial-prompt methodology.
• Comfortable reading AI regulatory requirements (EU AI Act, NIST AI RMF, ISO/IEC 42001) well enough to translate them into test coverage.
• Proficient in Python; comfortable wiring test suites into CI/CD (Cloud Build, GitHub Actions).
• Detail-oriented and comfortable owning a queue of failing checks across multiple agents at once.

Nice to Have

• Experience with Gemini Enterprise / ADK agents specifically, or another enterprise agent platform.
• Familiarity with RAG evaluation (faithfulness, hallucination, context precision/recall).
• Prior audit or compliance-adjacent work (SOC 2, ISO 27001, or similar) that makes evidence packaging second nature.

What Success Looks Like

By month two: every live agent has an active Trustworthiness evaluation suite running on every commit, with clear pass/fail thresholds.

By month four: audit-evidence packages are produced on a standing cadence without ad hoc requests, and dataset coverage gaps are tracked and closed as new agents onboard.

About Us

At Zensar, we’re "experience-led everything". We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: "Together, we shape experiences for better futures". Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus.

Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensar and join us to Grow. Own. Achieve. Learn. to be the best version of yourself.

We believe the best work happens when individuality is celebrated, growth is encouraged, and well‑being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.