Engineer III - App Engg & AI

Anblicks Inc.; Hyderabad; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Anblicks Inc. is seeking a Senior Automation QA Engineer in Hyderabad to lead test automation across API and UI layers for our AI-native platform. The ideal candidate will design test strategies using Pytest and Playwright, ensuring efficient quality gates in Azure DevOps.

With a focus on agent workflow testing, candidates should possess strong experience in QA automation, Python, and PostgreSQL. Join us to contribute to innovative LLM evaluation workflows and enhance our testing frameworks.

Qualifications

• 6+ years of experience in QA automation.
• Strong hands-on expertise with Pytest and Playwright.
• Solid proficiency in Python and PostgreSQL.
• Hands-on experience with Azure DevOps CI/CD pipelines.

Responsibilities

• Design and execute test strategies for API and UI layers.
• Own CI/CD quality gates in Azure DevOps.
• Build and maintain coverage for agent workflow testing.
• Develop reusable automation frameworks backed by PostgreSQL.
• Contribute to LLM evaluation and observability workflows.

Skills

QA automation

Pytest

Playwright

Azure DevOps

PostgreSQL

Python

Tools

Azure DevOps

PostgreSQL

Langfuse

Job description

We are looking for a Senior Automation QA Engineer to own end-to-end test automation across API and UI layers for our AI-native platform, including agent workflow validation.

Key Responsibilities

• Design and execute test strategies for API and UI layers using Pytest and Playwright (Angular).
• Own CI/CD quality gates in Azure DevOps, ensuring reliable build promotion and release readiness.
• Build and maintain coverage for agent workflow testing, including non-determinism, agent graph validation, and confidence score assertions.
• Develop reusable automation frameworks and data setup utilities backed by PostgreSQL.
• Contribute to LLM evaluation and observability workflows using Langfuse or similar tooling.

Required Qualifications

• 6+ years of experience in QA automation.
• Strong hands-on expertise with Pytest and Playwright, with proven depth in both API and UI automation.
• Solid proficiency in Python and experience working with PostgreSQL for test data and validation.
• Hands-on experience with Azure DevOps CI/CD pipelines and quality gates.
• Awareness of LLM/agent testing challenges (non-determinism, agent graph validation, confidence score assertions); exposure to Langfuse or LLM evaluation frameworks is a plus and can be built on the job.