Quality Engineer - Automation & AI

Mxv; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

DevRev is seeking a Quality Architect/Lead to build and scale AI-powered test automation systems for its next-gen AI native product. The role focuses on designing robust test programs that validate performance, reliability and UX, using AI-enabled methods across test generation, maintenance, and coverage.

The candidate will own automation framework health, develop self-healing tests, and drive shift-left testing with close collaboration with Engineering and DevOps.

Qualifications

• Seven+ years of experience in building customer-facing products and automation
• Experience designing and implementing automation frameworks from scratch
• Proficient in AI-assisted testing and leveraging it in test generation and maintenance
• Strong knowledge of CI/CD, Git, and modern testing tools
• Familiarity with testing Electron-based desktop apps and web apps

Responsibilities

• Design and maintain automated testing programs aligning with product requirements
• Develop and scale AI-powered test frameworks and ensure deterministic tests
• Integrate test suites into CI/CD with fast feedback and reporting
• Lead quality ownership and drive continuous improvement across releases
• Collaborate with engineering, product, and DevOps to prevent defects early

Skills

Automation framework

AI testing

CI/CD integration

Test design

Electron testing

Git/GitHub

Cloud (AWS/GCP)

Documentation

QA strategy

Tools

CircleCI

Playwright

Ginkgo

Job description

About DevRev

At DevRev, we're building the future of work with Computer – your AI teammate. Unlike traditional tools, Computer unifies all your data sources, tools, and workflows into a single AI-ready platform, giving employees real-time insights, proactive suggestions, and powerful agentic actions. It extends your existing software with AI-native apps and agents that work alongside your teams and customers – updating workflows, coordinating across teams, and eliminating repetitive work. We call this Team Intelligence: human-AI collaboration that breaks down silos, brings people back together, and frees you to solve bigger problems. Backed by Khosla Ventures and Mayfield with $150M+ raised, DevRev is trusted by global companies across industries.

About the role

We are looking for a Quality Architect/Lead with hands-on experience building quality systems and has deep expertise in building and scaling test automation frameworks.The role requires an individual who applies systems thinking to solving complex problems. They should be able to understand the product from various perspectives and be able to effectively create testing programs that validate not just functionality but performance, reliability and user experience. DevRev is building a next generation AI native product that requires us to build novel test systems for the Agent AI platform. The role is mult-faceted and is going to continuously evolve with time.

What you’ll do

• Test Case Design and Documentation
• Actively use AI and intelligent agents to accelerate test generation, test maintenance, and coverage expansion.
• Leverage LLMs to convert requirements, user stories, and production incidents into high-quality automated test cases.
• Reduce reliance on manual test case creation by introducing AI-assisted automation workflows, with human review and ownership.
• Apply AI to optimize test selection, prioritization, and execution based on risk, code changes, and historical failures.
• Use AI to assist in identifying missing scenarios, edge cases, and negative paths from requirements and user behavior.
• Maintain strong traceability between product features, test cases, and automated coverage, with AI support for documentation updates and gap analysis.

Test Suite Development

• Create frameworks and standards that help AI create deterministic and stable tests
• Establish coding standards, branching strategies, and review guidelines for automation code.
• Integrate test execution into CI/CD pipelines with fast feedback loops and real-time reporting.
• Design and Build tools that help with test generation, flakiness detection, self-healing tests, and intelligent exploratory testing
• Champion shift-left testing by working closely with engineering, product, and DevOps teams to prevent defects early.

Quality Ownership and Continuous Improvement

• Own the health and evolution of the automation framework.
• Build AI systems that triage test failures, flaky behavior, and production escapes
• Continuously improve testing strategies based on learnings from releases, incidents, and customer impact.
• Promote a strong quality mindset where AI is used as a force multiplier, not a shortcut.
• Engage with customers and customer facing teams to understand their perspective and bring it back to Engineering for improving the product.

What You’ll Bring:

• 7+ years of experience building customer-facing products
• Skill in writing high-quality, maintainable code any one programming language
• Demonstrated experience building an automation framework from scratch, with organized test categorization, reusability, and CI/CD integration.
• Strong understanding of software testing methodologies, test planning, and test strategy.
• Familiarity with using AI to enhance testing and software development.
• Strong problem-solving skills and attention to detail.
• Experience with Git, GitHub, CircleCI and cloud services like AWS/GCP
• Excellent communication, teamwork, and documentation skills, with a strong ability to advocate for best practices.
• Experience with testing modern web applications and Desktop applications based on Electron

Preferred Skills:

• Experience with defining a QA strategy and execution for a product that is now live
• Knowledge of test framework design and development.
• Strong understanding of test reporting tools and technologies.
• Experience with UI and API testing like Ginkgo and Playwright
• Experience with Performance and Stress testing

Nice to Have

• People management skills (Direct or Indirect)
• Experience building systems to validate AI systems including Agents

Join us in innovating our testing processes and ensuring the delivery of high-quality software products through advanced automation techniques.

DevRev is an equal opportunity employer and does not discriminate on the basis of race, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition, or any other basis protected by law.