Software Dev Engineer Test I

MetLif; Hyderabad; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

MetLife is seeking an AI Engineer (Software Developer in Test/QA) to strengthen software quality across Agile, cloud-native, and AI-enabled teams. You will design and execute tests for APIs, UI, and AI components, developing automation frameworks and validating Generative AI, LLM, and RAG workflows.

The role requires hands-on automation experience with Selenium, Playwright, Cypress, and CI/CD tools, plus familiarity with Azure services and DevOps practices.

Qualifications

• 2 to 5 years of experience in software testing, quality engineering, test automation, reliability engineering, or similar roles.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Hands-on experience with automation tools such as Selenium, Playwright, Cypress, TestNG, Cucumber, RestAssured, PyTest, Postman/Newman, or similar frameworks.
• Practical experience in Agile and DevOps environments with Azure DevOps, Docker, Jenkins, Selenium Grid, TDD/BDD, and CI/CD practices.
• Exposure to frontend, backend, REST API, microservices, cloud-native applications, and database validation.
• Experience with Azure services such as App Services, Azure SQL Database, Azure Storage, Azure OpenAI, and Entra ID/OAuth is preferred.
• Knowledge of AI/LLM applications, RAG systems, LangChain, LangGraph, Semantic Kernel, Agentic AI frameworks, AI coding assistants, ML concepts, AI observability, vector databases, and performance tools such as JMeter or BlazeMeter will be a strong advantage.

Responsibilities

• Strengthen software quality across Agile, cloud-native, and AI-enabled delivery teams.
• Design, execute, and maintain test plans, test cases, and validation strategies across multiple testing levels including API and end-to-end.
• Develop and maintain reusable automation frameworks and validation scripts for UI, API, backend, and integration testing.
• Promote automation-first quality practices to improve release confidence and engineering productivity.
• Design and execute evaluation strategies for Generative AI, LLM, RAG, and Agentic AI systems, including automated evaluation pipelines.

Skills

Selenium

Playwright

Cypress

TestNG

Cucumber

RestAssured

PyTest

Postman

Azure DevOps

Docker

Jenkins

Selenium Grid

CI/CD

Frontend & Backend

Azure OpenAI

Education

Bachelor's degree in Computer Science / IT / Engineering

Tools

Azure DevOps

Docker

Jenkins

Selenium Grid

Job description

AI Engineer (Software Developer in Test/QA)

Role Overview

An AI Testing Engineer / SDET will be responsible for strengthening software quality across Agile, cloud-native, and AI-enabled delivery teams. The role requires strong programming fundamentals, test automation expertise, and the ability to validate traditional applications as well as emerging Generative AI, RAG, and Agentic AI solutions. The engineer will work closely with software developers, architects, AI engineers, and DevOps teams to improve release quality, automate validation, reduce manual effort, and support AI-driven SDLC initiatives.

Key Responsibilities

Quality Engineering and Testing

• Understand application architecture, APIs, databases, source code, authentication flows, cloud integrations, and business workflows.
• Design, execute, and maintain test plans, test cases, and validation strategies across unit, functional, integration, system, API, end-to-end, and regression testing.
• Identify, document, track, and verify defects while ensuring the new functionality does not impact existing features.

Automation and Reliability Engineering

• Develop and maintain reusable automation frameworks, test suites, validation scripts, and regression capabilities for UI, API, backend, and integration testing.
• Improve test coverage, release confidence, and engineering productivity by promoting automation-first quality practices.

AI Evaluation & Agentic Validation

• Design and execute evaluation strategies for Generative AI, LLM, RAG, and Agentic AI systems, including benchmark datasets and automated evaluation pipelines.
• Validate AI quality metrics such as accuracy, relevance, groundedness, faithfulness, hallucination detection, response quality, and latency.
• Test RAG workflows including ingestion, chunking, indexing, retrieval, ranking, response generation, prompt quality, agents, tools, workflows, and orchestration frameworks.

Candidate Qualifications

• 2 to 5 years of experience in software testing, quality engineering, test automation, reliability engineering, or similar roles.
• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• Hands-on experience with automation tools such as Selenium, Playwright, Cypress, TestNG, Cucumber, RestAssured, PyTest, Postman/Newman, or similar frameworks.
• Practical experience in Agile and DevOps environments with Azure DevOps, Docker, Jenkins, Selenium Grid, TDD/BDD, and CI/CD practices.
• Exposure to frontend, backend, REST API, microservices, cloud-native applications, and database validation.
• Experience with Azure services such as App Services, Azure SQL Database, Azure Storage, Azure OpenAI, and Entra ID/OAuth is preferred.
• Knowledge of AI/LLM applications, RAG systems, LangChain, LangGraph, Semantic Kernel, Agentic AI frameworks, AI coding assistants, ML concepts, AI observability, vector databases, and performance tools such as JMeter or BlazeMeter will be a strong advantage.

About MetLife

Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World’s 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world’s leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East. As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We’re looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value. Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we’re inspired to transform the next century in financial services. At MetLife, it’s #AllTogetherPossible .Join us!