QA Engineer (AI Product Testing)

EG A/S; Mangaluru; On-site; INR 1,500,000 - 2,700,000; Full time

Job summary

EG Intelligence in India seeks a QA Engineer to own the test strategy across our AI platform and customer-facing product, spanning SDK, gateway, guardrails, and desktop application. You will design automation frameworks, build contract tests, and collaborate with platform engineers to deliver high-quality software across AWS, Azure, and private cloud environments.

You will champion TDD, automation-first testing, and observability in test results, while driving continuous improvement in test

Qualifications

• 5+ years of experience in software quality engineering.
• Proven experience as a QA engineer in AI/ML product teams – testing AI/ML workloads, LLM-powered applications, agent orchestration systems, or similar AI-native products.
• Demonstrated adoption of test-driven development (TDD) and automation-first approaches.
• Deep experience with E2E and integration testing frameworks (Playwright, Cypress, Pytest, xUnit, Postman/Newman).
• Experience with contract testing frameworks (Pact, Spring Cloud Contract).
• Proficiency in at least two of: Python, .NET/C#, TypeScript.
• Strong CI/CD pipeline experience (GitHub Actions, Azure DevOps, Jenkins).
• Experience with performance and load testing tools (k6, Locust, Gatling, JMeter).
• Experience testing real-time, event-driven, or streaming interfaces.
• Familiarity with cloud-native testing across AWS and Azure.
• Knowledge of GDPR / data sovereignty in testing contexts.
• Experience in platform/product teams shipping to internal and external users.

Responsibilities

• Own the end-to-end test strategy across the AI platform and customer-facing product.
• Design and build test automation frameworks from scratch.
• Build and maintain SDK contract test suites (e.g. Pact) across Python, .NET, and Java SDKs.
• Develop integration and E2E test suites for agent workflows and marketplace flows.
• Create test approaches for AI-generated outputs and non-deterministic outputs using evaluation frameworks.
• Create and execute guardrail and policy regression suites.
• Design and run performance and load tests to validate SLAs.
• Integrate all test suites into CI/CD pipelines with pass/fail gates and dashboards.
• Test across desktop environments for consistent behavior and accessibility.
• Collaborate with engineers to embed quality from the first line of code.
• Contribute to release-readiness assessments and maintain quality bar.
• Champion test automation and observability in test results.

Job description

About EG

At EG, we build software that makes a difference.

At EG, we build software that makes a difference.

Our industry-specific software helps people and businesses work smarter every day. From doctors spending more time with patients to builders running safer, more efficient projects.

Our software is built by peers from the industry and backed by EG's scale for stability, innovation, and security. We are a thriving global workforce of 3000+ employees, with a 900+ strong team based in Mangaluru, India.

If you are ambitious, curious, and take pride in ownership, you will thrive here. You will be trusted to grow your skills, shape meaningful solutions, and make an impact together with talented colleagues across borders.

You will join one of EG’s most ambitious initiatives: the EG Intelligence Platform and Genie. Beyond using AI, you’ll play a key role in testing and validating AI products in real-world production environments.

About The Role

We are building EG's common AI platform and its customer-facing experience layer. Our mission is to give business units and 150+ products a single, sovereign-by-design foundation for shipping AI features: one SDK, one gateway, one set of guardrails, one observability stack - deployed across AWS, Azure, and private cloud. The platform spans five domains - Enablement, Execution, Grounding, Governance, and Operate.

On top of this platform, we are building an SMB-focused, sub-vertical-tailored desktop assistant with a marketplace and an agent-builder - the customer-facing product through which users across EG's verticals access AI functionality daily.

As QA Engineer, you will be the quality conscience across both the platform and the product - not siloed into one. You will own the test strategy that spans SDK, gateway, agent runtime, guardrails, the desktop application, marketplace, and agent-builder.

The blueprint is in place. Now we are mobilising the team that will make it happen.

We are hiring for a lean team that can multiply. The people joining this team are experienced and they know how to race with technology. They don't wait for direction - they set it and earn followership through their technical credibility and their ability to bring people with them.

You know the difference between being busy and moving something forward. You have learned how to partner with AI not as an assistant, but as a genuine force multiplier that makes you and every team around you faster.

You will be part of a central team with a company-wide mandate where the principles are to be transparent by default, be an active participant across EG, and a close partner to the BUs and their product teams.

If that sounds like you, we'd like to hear from you.

We are EG Intelligence!

Your Role, Key Responsibilities

• Own the end-to-end test strategy across the AI platform and customer-facing product - covering SDK, LLM/Model Gateway, agent runtime, guardrails, observability, desktop application, marketplace, and agent-builder.
• Design and build test automation frameworks from scratch - defining structure, patterns, utilities, and reporting across both platform services and product surfaces.
• Build and maintain SDK contract test suites (e.g. Pact) that protect consuming teams from breaking changes across Python, .NET, and Java SDKs.
• Develop integration and E2E test suites for agent workflows, tool-calling pipelines, marketplace install/update flows, and agent-builder configuration scenarios - spanning AWS, Azure, and sovereign cloud environments.
• Create test approaches for AI-generated outputs - including response quality evaluation, guardrail enforcement validation, and non-deterministic output handling using evaluation frameworks (e.g. Ragas, DeepEval).
• Create and execute guardrail and policy regression suites to ensure compliance posture is never degraded by a release.
• Design and run performance and load tests - validating throughput, latency SLAs, and failover behaviour under production-like conditions.
• Integrate all test suites into CI/CD pipelines with clear pass/fail gates, automated reporting, trend dashboards, and release-gate validations.
• Test across desktop environments and ensure consistent behaviour, performance, and accessibility standards are met.
• Partner with platform and product engineers to embed quality from the first line of code - participate in design reviews, define acceptance criteria, and advocate for testability in architecture decisions.
• Contribute to release-readiness assessments, ensuring every release meets the AI Release Readiness quality bar before rollout.
• Champion a quality-first culture - advocating for test-driven development (TDD), automation-first testing, observability in test results, and continuous improvement in test coverage.
• Track and report quality metrics - test coverage, defect trends, release health - and use them to drive continuous improvement.

Your Profile And Mandatory Skill Set

• 5+ years of experience in software quality engineering with strong hands‑on test automation skills - you write code to test code.
• Proven experience as a QA engineer in AI/ML product teams – testing AI/ML workloads, LLM-powered applications, agent orchestration systems, RAG pipelines, or similar AI‑native products. This is a core requirement, not a nice‑to‑have.
• Demonstrated adoption of test‑driven development (TDD) and automation‑first approaches - you build test frameworks before shipping features, and you champion TDD as a standard practice in your teams.
• Deep experience with E2E and integration testing frameworks (e.g. Playwright, Cypress, Pytest, xUnit, Postman/Newman) across web, desktop, and distributed architectures.
• Experience with contract testing frameworks (e.g. Pact, Spring Cloud Contract) to validate API and SDK interfaces.
• Proficiency in at least two of: Python, .NET/C#, TypeScript - with the ability to work across the SDK surface in all three.
• Strong CI/CD pipeline experience - building test stages, quality gates, and automated reporting in tools such as GitHub Actions, Azure DevOps, or Jenkins.
• Experience with performance and load testing tools (e.g. k6, Locust, Gatling, JMeter) and interpreting results under varying concurrency and payload profiles.
• Experience testing real‑time, event‑driven, or streaming interfaces - chat UIs, WebSocket connections, live‑updating dashboards.
• Familiarity with cloud‑native testing across AWS and Azure - including IAM, networking, and infrastructure‑as‑code (Terraform/Bicep) contexts.
• Strong collaboration skills - you work embedded with engineers, not in a separate QA silo. You are a quality advocate, not a bottleneck.
• Experience with AI/LLM evaluation frameworks (e.g. Ragas, DeepEval, promptfoo) for non‑deterministic output validation and prompt testing.
• Familiarity with observability stacks (Grafana, LangFuse, OpenTelemetry) and using traces/metrics for test validation.
• Exposure to policy‑as‑code frameworks (OPA/Rego) and compliance‑driven testing.
• Knowledge of MCP (Model Context Protocol) or agent orchestration patterns.
• Familiarity with visual regression testing tools (e.g. Percy, Chromatic, BackstopJS) and accessibility testing.
• Exposure to desktop application testing (Electron, Tauri, or similar) including packaging, updates, and OS‑specific behaviour.
• Familiarity with marketplace or plugin‑based application testing - install flows, versioning, sandboxing, and compatibility matrices.
• Knowledge of GDPR, EU AI Act, or sovereign data requirements in a testing context.
• Experience in a platform or product team shipping to internal consumers alongside external end‑users.

What Can You Expect From Us

• A collaborative and dynamic work environment within a rapidly expanding software company, where you can shape your role.
• Professional growth opportunities through challenging projects and the chance to make a real impact
• The chance to play a pivotal role in shaping the future of vertical software, working with a global finance team that values innovation and continuous improvement.
• Direct exposure to cutting‑edge AI/ML technologies, multi‑cloud architectures, and sovereign‑by‑design systems across business units and 150+ products.

Our Values

• Lead the Industry - We bring deep industry expertise and help our customers lead their industry
• Make it Happen - We take ownership, move fast and deliver real impact
• Stronger Together - We collaborate across borders with high standards, trust, openness and no politics.

Join us in creating software that works for people, not software that makes people work

Curious what it's really like to work at EG?

Explore life at EG, meet some of your future colleagues, and see our values in action: Working at EG

See all our open positions here

Learn more about EG here.