Sr./Lead QA Automation Engineer - AI Agent

Simcorp; Dadri; Presencial; INR 1.800.000 - 3.000.000; Jornada completa

Descripción de la vacante

SimCorp is seeking a Sr./Lead QA Automation Engineer to own the quality strategy for a production-grade AI agent used across the SDLC. The role blends hands-on manual testing with designing and building an automated test system supporting acceptance, integration, contract, and post-deployment validation to ship quickly without breaking critical engineering workflows.

You will define the test strategy, perform manual and exploratory testing, and design approaches for testing non-deterministic

Formación

• 6+ years of experience in quality engineering / test automation for complex web and API platforms.
• Strong C#/.NET test development skills: xUnit/NUnit-style frameworks, mocks and fakes, test fixtures, and CI integration.
• Solid experience with API and integration testing, including authentication and distributed-system failure modes.
• Experience with browser automation such as Playwright, Selenium, or equivalent.
• Strong manual and exploratory testing skills, and the ability to design test strategies rather than only execute predefined cases.
• Understanding of CI/CD pipelines, test categorization, flaky-test management, and post-deployment smoke testing.
• Ability to investigate failures using logs, traces, telemetry, screenshots, and reproducible minimal scenarios.
• Experience testing AI/LLM products, agentic workflows, streaming responses, or other non-deterministic behavior is a strong advantage.
• At least 1 year of hands-on experience using AI coding agents such as Claude Code or Codex in daily work.
• Familiarity with open-source agents and how they behave in practice.
• Passion for the AI space and the ability to adopt new technologies and practices.

Responsabilidades

• Define and own the product's test strategy across unit, functional, integration, acceptance, post-deployment, and exploratory testing.
• Perform hands-on manual and exploratory testing of new features, AI-agent behavior, and edge cases before and alongside automation.
• Design approaches for testing non-deterministic AI/LLM behavior, tool-use correctness, and prompt regressions.

Conocimientos

C#/.NET

xUnit/NUnit

Playwright/Selenium

API testing

CI/CD

Exploratory testing

AI/LLM testing

Linux

Docker

Open-source agents

Educación

Bachelor's/Master's in CS/Engineering or related

Herramientas

Playwright

Selenium

Docker

Azure

Descripción del empleo

Job Summary

Sr./Lead QA Automation Engineer - AI Agent

Are you a quality engineer who wants to build confidence in a fast-evolving AI agent - not just execute manual test cases. At SimCorp, we are developing an internal AI agent that supports the software development lifecycle (SDLC): a production-grade, distributed agent hosted in Azure - running 24/7, accessible to everyone in the company, and spanning deep integrations with our engineering systems, secure code execution, and remote development capabilities on user machines.

We are looking for a QA Automation Engineer to own and evolve the quality strategy for this product. The product's risk sits in cross-service behavior - where agent runs, tool calls, external integrations, and cloud infrastructure meet.

The role blends hands-on manual and exploratory testing of new features and AI behavior with designing and building the automated test system - acceptance, integration, contract, and post-deployment validation - that lets the team ship quickly without breaking critical engineering workflows.

Responsibilities Test strategy and hands-on testing

• Define and own the products test strategy across unit, functional, integration, acceptance, post-deployment, and exploratory testing.
• Perform hands-on manual and exploratory testing of new features, AI-agent behavior, and edge cases before and alongside automation.
• Design approaches for testing non-deterministic AI/LLM behavior, tool-use correctness, and prompt regressions.

Automated coverage

• Build browser-level acceptance tests that cover key user journeys end to end, from the UI down to persistence and background processing.
• Create validation for MCP endpoints, including authentication flows, client compatibility, and tool schemas.
• Design contract and replay-based tests for critical external integrations where live systems are slow, expensive, or unstable.
• Strengthen test coverage for the highest-risk execution surfaces: sandboxed code execution and the agents remote sessions on user machines.

Release confidence and test infrastructure

• Add post-deployment smoke tests that catch environment, configuration, and identity failures, giving rollback confidence.
• Introduce failure-injection scenarios - service restarts, network loss, expired tokens, rate limits - to prove the product degrades gracefully.
• Improve test data, fixtures, fake connectors, and CI test categorization; manage flaky tests and keep pipelines fast and trustworthy.

Collaboration and quality leadership

• Partner with engineers to make features testable and define acceptance criteria before implementation; mentor the team in testing practices.
• Monitor quality signals from CI, static analysis, telemetry, production incidents, and user feedback, and build release-readiness reporting.

What we value

Most importantly, you can see yourself contributing and thriving in the position described above. We expect you to be strong in several of the following and interested in learning the rest:

• Bachelors or Masters degree in Computer Science, Engineering, Mathematics, or a related field.
• 6+ years of experience in quality engineering / test automation for complex web and API platforms.
• Strong C#/.NET test development skills: xUnit/NUnit-style frameworks, mocks and fakes, test fixtures, and CI integration.
• Solid experience with API and integration testing, including authentication and distributed-system failure modes.
• Experience with browser automation such as Playwright, Selenium, or equivalent.
• Strong manual and exploratory testing skills, and the ability to design test strategies rather than only execute predefined cases.
• Understanding of CI/CD pipelines, test categorization, flaky-test management, and post-deployment smoke testing.
• Ability to investigate failures using logs, traces, telemetry, screenshots, and reproducible minimal scenarios.
• Experience testing AI/LLM products, agentic workflows, streaming responses, or other non-deterministic behavior is a strong advantage.
• At least 1 year of hands-on experience using AI coding agents such as Claude Code or Codex in your daily work.
• Familiarity with open-source agents (e.g., OpenCode, Hermes, OpenClaw, or similar) and how they behave in practice.
• Passion for the AI space and the flexibility to try new technologies: you stay on top of market trends and bring the ecosystems best practices - better memory, context management, and agent autonomy - into how we build and test the product.
• Working knowledge of Linux and containerized environments (Docker), enough to test and investigate sandboxed code execution, is a strong advantage.
• Experience with Test containers, contract testing, Azure identity, or Windows automation is a plus.
• Proven ability to lead quality direction, influence engineers, and raise the testing bar across a team.
• Excellent English communication skills, both written and spoken.