Senior Test Engineer with Agentic AI

NTT America, Inc.; Roma; Ibrido; EUR 60.000 - 90.000; Tempo pieno

Vantaggi offerti da questo lavoro

Private Health Insurance

Sponsored certifications

Coaching School

Team events

Descrizione del lavoro

NTT DATA Romania is seeking a Senior Test Engineer to lead the end-to-end testing lifecycle for AI solutions. You will define the test strategy, develop test plans, and create SIT regression suites while coordinating UAT and performance scripts as needed.

You will manage SIT/UAT schedules, ensure alignment with project goals, and drive high-quality delivery across testing phases with a strong focus on automation and data-driven reporting.

Competenze

• Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent experience.
• AI testing experience is mandatory.
• AI agents orchestration know how is mandatory.
• Test data analysis competency.
• Iterative, Agile, or similar methodology experience.
• Excellent stakeholder communication skills, able to summarise a complicated data set into meaningful progress reports.
• Experience with industry standard test management tools (MS Azure DevOps).
• Proficient at defect management workflows and processes.
• ISEB/ISTQB or equivalent certification in testing.
• Experience working in the Insurance industry.
• Strong understanding of low-code or script-assisted automation using tools like Katalon.
• Tracks KPIs and integrates automation and NFT checks into quality governance reporting.
• Knowledge of CI/CD tools such as ADO, GitHub Actions, or GitLab CI/CD.
• Ensure functional test cases, automation packs, and test data align with continuous integration workflows.
• Automation planning, automation-first strategies, or low-code/no-code automation tools.
• Ability to validate non-functional aspects with performance Lead.

Mansioni

• Testing AI solutions generated in Pega and Azure, and using AIS/Integro for integrations.
• Participate in test environment preparation discussions.
• Develop end-to-end Test Strategy and plans for the project.
• Define test objectives, scope and deliverables.
• Coordinate with stakeholders to ensure testing requirements are met.
• Manage the test team and ensure efficient preparation and execution of test cases.
• Ensure SIT & UAT environments include all required systems and test data.
• Ensure prerequisites for SIT & UAT execution are met and aligned with schedule.
• Define SIT & UAT Schedule to support project outcomes.
• Lead education of business users/testers on the test strategy.
• Support business in creating end-to-end business test scenarios.
• Produce SIT & UAT Schedule in alignment with the Project Plan.
• Coordinate SIT & UAT execution across lines of business and units.
• Manage defects raised during SIT & UAT until resolution per process.
• Track progress and produce Daily Status Reports for stakeholders.
• Implement SIT & UAT Quality Gates and remedial tasks.
• Chair SIT & UAT progress meetings with stakeholders.
• Produce SIT & UAT Summary Report.
• Provide progress updates to Project Manager.
• Escalate risks and issues to Project Manager.
• Provide estimations for testing timelines and resources.

Conoscenze

AI testing

AI orchestration

Test data analysis

Agile methodology

Stakeholder communication

Defect management

Insurance industry

Low-code automation

CI/CD tools

English proficiency

Formazione

Bachelor’s or Master’s in CS/Engineering

ISTQB/ISEB certification

Strumenti

Azure DevOps

Katalon

GitHub Actions

GitLab CI/CD

Descrizione del lavoro

Who we are

As a Senior Test Engineer with Agentic AI, you will lead the end‑to‑end testing lifecycle, including defining the overall test strategy, developing comprehensive test plans, and creating new SIT test cases. Your responsibilities include maintaining and executing SIT regression suites, overseeing business‑driven UAT test cases, and coordinating performance test scripts when required. You will manage the testing RAID log, ensure clear reporting through SIT and UAT test summary reports, and drive high‑quality delivery across all testing phases.

What you'll be doing

• Testing of AI solutions generated in Pega and Azure, and using AIS/Integro for integrations

• Active participation in test environment preparation discussions

• Develop end-to-end Test Strategy accounting for downstream regression tests, SIT, UAT etc

• Develop test strategy and plans for the project

• Define test objectives, scope and deliverables

• Coordinate with stakeholders to ensure testing requirements are met

• Manage the test team and ensure efficient preparation and execution of test cases

• Firm understanding of all the project level integrations and ensuring the SIT & UAT environment includes all required systems, components, and test data

• Ensure all prerequisites for SIT & UAT execution are met, and execution proceeds in accordance with the SIT & UAT schedule

• Define the SIT & UAT Schedule which will support delivery against the defined project outcomes

• Lead education of the business users/testers on agreed test strategy and approaches

• Provide support to the business on the creation of robust end‑to‑end business test scenarios

• Produce SIT & UAT Schedule in alignment with the Project Plan, whilst ensuring availability and buy‑in

• Co‑ordinate SIT & UAT execution activities acrossalllines of business, as well as business units (i.e. Operations, Claims & Finance)

• Management of defects raised during SIT & UAT execution until resolution, in accordance with the agreed SIT & UAT Management Process

• Track progress of SIT & UAT execution and produce Daily Status Reports for circulation amongst Project and Business Stakeholders

• Implementation of SIT & UAT Entry/Exit Quality Gates, including the facilitation of any remedial tasks/actions

• Chair regular SIT & UAT Progress Meetings with the delegated Business Testers, IT Rep and Business Analyst

• Produce SIT & UAT Summary Report

• Regular updates to Project Manager on progress to plan

• Escalate risks and issues to Project Manager

• Provide estimations for testing - timelines and resource

What you’ll bring along

• Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent experience

• AI testing experience is mandatory

• AI agents orchestration know how is mandatory

• Test data analysis competency

• Iterative, Agile, or similar methodology experience

• Excellent stakeholder communication skills, able to summarise a complicated data set into meaningful progress reports

• Experience with industry standard test management tools (MS Azure DevOps)

• Proficient at defect management workflows and processes

• ISEB/ISTQB or equivalent certification in testing

• Experience working in the Insurance industry

• A strong understanding of how teams build and maintain low‑code or script‑assisted automation using tools like Katalon

• Tracks KPIs and integrates automation and NFT checks into quality governance reporting

• Understand CI/CD tools such as ADO, GitHub Actions, or GitLab CI/CD

• Ensure functional test cases, automation packs, and test data align with continuous integration workflows

• Experience with automation planning, automation‑first strategies, or low‑code/no‑code automation tools

• Ability to validate non‑functional aspects with performance Lead (performance baselines, resilience under load, platform constraints)

• Knowledge of Scrum, Agile is essential

• Good speaking capability in English

What’s in it for you

• New beginnings can be a challenge. We promise a smooth integration and a supportive mentor

• Pick your working style: choose from Remote, Hybrid or Office work opportunities

• Early bird or night owl? Our projects have different working hours to suit your needs

• Nobody is born an expert. Sharpen your tech skills with our sponsored certifications, trainings and top e-learning platforms

• We want you to stay healthy! Enjoy our Private Health Insurance – it’s custom‑made for you

• A clear mind is a healthy mind. Attend individual coaching sessions or go one step further by joining our accredited Coaching School

• Make the most of our epic parties or themed events – they’re lovingly designed for our people and their families

NTT DATA Romania is an equal opportunity employer and considers all applicants regardless to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees.

Make this the place you grow

Your unique talent is what matters. NTT DATA Romania is an equal opportunity employer and considers all applicants regardless to race, color, religion, citizenship, national origin, ethnicity, age, gender, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic.