We are seeking an experienced AI and Mobile Test Automation Engineer to drive quality engineering initiatives across mobile applications, APIs, and AI-powered products. The ideal candidate should possess strong expertise in mobile automation, API testing using Rest Assured, and modern AI testing methodologies.
This role combines traditional QA automation with next-generation AI testing practices to ensure reliability, scalability, and accuracy of intelligent applications.
The candidate will have responsibilities across the following functions:
Mobile Test Automation
- Design, develop, and maintain automated test frameworks for Android and iOS applications.
- Create robust end-to-end mobile automation suites.
- Perform functional, regression, integration, and smoke testing.
- Validate mobile application performance, usability, and compatibility across devices.
- Execute cross-platform testing and device coverage strategies.
API Test Automation
- Develop and maintain API automation frameworks using Rest Assured.
- Validate RESTful services, microservices, and backend integrations.
- Design automated API regression suites.
- Perform contract testing and service validation.
- Integrate API automation into CI/CD pipelines.
AI Testing and Quality Engineering
- Test AI-powered applications, chatbots, copilots, and LLM-based systems.
- Validate AI response accuracy, consistency, relevance, and safety.
- Design prompt validation and AI evaluation test scenarios.
- Create test datasets and benchmarking frameworks for GenAI applications.
- Verify RAG-based systems and AI agent workflows.
- Monitor AI quality metrics and identify model-related defects.
Quality Engineering
- Collaborate with Product Managers, Developers, and AI Engineers.
- Define test strategies and quality gates.
- Drive automation-first testing practices.
- Participate in Agile ceremonies and release planning.
- Ensure high-quality software delivery through continuous testing.
Requirements
- Experience testing OpenAI, Gemini, Claude, or other LLM-based applications.
- Knowledge of LangChain, LangGraph, CrewAI, or Agentic AI systems.
- Experience with performance testing tools such as JMeter.
- Exposure to cloud platforms (AWS, Azure, GCP).
- Knowledge of AI observability and evaluation frameworks.
- Experience in telecom, fintech, e-commerce, or digital products.
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field.
Mandatory Skills
- API Automation: Rest Assured, Postman, API Validation, JSON/XML Parsing, Microservices Testing.
- Programming: Java, Selenium WebDriver, TestNG / JUnit, Maven / Gradle.
- AI Testing: Generative AI Testing, LLM Validation, Prompt Testing, AI Response Evaluation, RAG Testing, Chatbot Testing.
- CI/CD and DevOps: Jenkins, GitHub Actions, GitLab CI/CD, Docker (Good to Have).
- Test Management: JIRA, Confluence, Test Planning and Reporting, Defect Lifecycle Management.
Key Competencies
- Strong analytical and debugging skills.
- Automation-first mindset.
- Understanding of AI quality and evaluation methodologies.
- Excellent communication and stakeholder management.
- Ability to work in fast-paced Agile environments.
Expectations
- Automation coverage across mobile and API layers.
- Reduction in production defects.
- AI response quality and validation effectiveness.
- Test execution efficiency and release readiness.
- Continuous improvement of QA automation frameworks.