Ai Automation Cgi Chennai Bengaluru

vibehackers

Chennai District

Sur place

INR 1 200 000 - 2 400 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

vibehackers in Chennai, India is seeking an Automation Quality Engineer to design, develop, and maintain automation test frameworks in Java and/or Python for AI-enabled applications, including LLM-based systems, RAG pipelines, and vector databases.

You will validate prompts, test embeddings, and integrate with CI/CD, collaborating with data scientists and developers to ensure quality, performance, and security.

Qualifications

  • Strong programming skills in Python and/or Java.
  • Hands-on experience with automation testing frameworks (Selenium, Playwright, REST Assured, PyTest).
  • Practical experience with LLMs (OpenAI GPT, Azure OpenAI, or similar).
  • Solid understanding and exposure to RAG architectures.
  • Experience working with vector databases for embeddings and semantic search (FAISS, Pinecone, Chroma, Weaviate).
  • Hands-on usage of OpenAI APIs (chat/completions, embeddings, etc.).
  • Experience with LangChain for prompt chaining, memory, and tool usage.
  • Strong knowledge of API testing, SQL, and data validation.
  • Familiarity with CI/CD tools such as Jenkins, GitHub Actions, Azure DevOps.
  • Good understanding of SDLC, STLC, and Agile methodologies.

Responsabilités

  • Design, develop, and maintain automation test frameworks using Java and/or Python.
  • Implement UI, API, and backend automation using tools such as Selenium, Playwright, REST Assured, PyTest, or similar.
  • Validate LLM-based applications for prompt accuracy, response quality, hallucination detection, and consistency.
  • Test and evaluate RAG pipelines, including document ingestion, embeddings, retrieval accuracy, and response relevance.
  • Work with vector databases (FAISS, Pinecone, Chroma, Weaviate) to validate indexing, retrieval, and performance.
  • Integrate and test applications using OpenAI APIs and similar LLM providers.
  • Leverage LangChain (or equivalent frameworks) to test chains, agents, tools, and workflows.
  • Create automated test cases for AI workflows, model outputs, prompt versions, and inference pipelines.
  • Implement data-driven and AI-assisted testing strategies and participate in CI/CD pipelines to enforce quality gates.
  • Collaborate with Data Scientists, Developers, and Product teams to define quality metrics and ensure compliance with security, performance, and scalability standards.

Connaissances

Python
Java
Selenium
Playwright
REST Assured
PyTest
OpenAI APIs
LangChain
API Testing
SQL
CI/CD
Security Testing

Outils

Selenium
Playwright
REST Assured
PyTest

Description du poste

Heavy focus on testing LLMs, RAG, vector DBs and LangChain—so it's directly about working with AI dev tools and prompt/output validation.

About the Role

Automation Quality Engineer responsible for designing, developing, and maintaining automation test frameworks in Java and/or Python to validate AI-enabled applications. The role focuses on testing LLM-based systems, RAG pipelines, vector databases, OpenAI APIs, and integrating AI-specific test strategies into CI/CD pipelines to ensure quality, performance, and reliability.

Job Description
Role

Seeking an Automation Quality Engineer with strong hands-on experience in Java and/or Python automation frameworks and practical exposure to AI-driven testing. The role focuses on validating intelligent applications and ensuring quality, reliability, performance, and security of AI-enabled systems.

Key Responsibilities
  • Design, develop, and maintain automation test frameworks using Java and/or Python.
  • Implement UI, API, and backend automation using tools such as Selenium, Playwright, REST Assured, PyTest, or similar.
  • Validate LLM-based applications for prompt accuracy, response quality, hallucination detection, and consistency.
  • Test and evaluate RAG pipelines, including document ingestion, embeddings, retrieval accuracy, and response relevance.
  • Work with vector databases (FAISS, Pinecone, Chroma, Weaviate) to validate indexing, retrieval, and performance.
  • Integrate and test applications using OpenAI APIs and similar LLM providers.
  • Leverage LangChain (or equivalent frameworks) to test chains, agents, tools, and workflows.
  • Create automated test cases for AI workflows, model outputs, prompt versions, and inference pipelines.
  • Implement data-driven and AI-assisted testing strategies and participate in CI/CD pipelines to enforce quality gates.
  • Collaborate with Data Scientists, Developers, and Product teams to define quality metrics and ensure compliance with security, performance, and scalability standards.
Requirements
  • Strong programming skills in Python (and/or Java).
  • Hands-on experience with automation testing frameworks such as Selenium, Playwright, REST Assured, PyTest, etc.
  • Practical experience with LLMs (OpenAI GPT, Azure OpenAI, or similar).
  • Solid understanding and exposure to RAG architectures.
  • Experience working with vector databases for embeddings and semantic search (FAISS, Pinecone, Chroma, Weaviate).
  • Hands-on usage of OpenAI APIs (chat/completions, embeddings, etc.).
  • Experience with LangChain for prompt chaining, memory, and tool usage.
  • Strong knowledge of API testing, SQL, and data validation.
  • Familiarity with CI/CD tools such as Jenkins, GitHub Actions, Azure DevOps.
  • Good understanding of SDLC, STLC, and Agile methodologies.
Good-to-Have
  • Certifications in LLMs and/or Python.
  • Exposure to AI-assisted testing strategies and emerging AI QA tools.
  • Experience with performance testing of AI-enabled systems.
  • Knowledge of cloud-based AI platforms and orchestration frameworks.
Skills

Automation Testing Test Framework Design API Testing UI Testing Data Validation SQL CI/CD SDLC STLC Agile Collaboration Performance Testing Security and Scalability Compliance AI-assisted Testing Prompt/LLM Validation

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Quality Assurance Automation Engineer
Quality Assurance Automation Engineer

MOURI Tech • Hyderabad

Hybride
INR 2 500 000 - 4 500 000
Lead AI Test Engineer
Lead AI Test Engineer

Qentelli LLC • Hyderabad

Sur place
INR 1 800 000 - 2 400 000
AI Automation Engineer
AI Automation Engineer

Quarks Technosoft Pvt. Ltd. • Bengaluru

Hybride
INR 1 500 000 - 2 300 000
Hybrid work model
AI Test Engineer
AI Test Engineer

AXA Global Business Services • Pune District, Bengaluru

Hybride
INR 1 200 000 - 1 800 000
AI Test Engineer
AI Test Engineer

AXA Global Business Services (AXA GBS) • Pune District

Sur place
INR 900 000 - 1 500 000
Qa Automation Lead
Qa Automation Lead

Bounteous • Gurugram District, Bengaluru

Hybride
INR 1 200 000 - 2 000 000
Artificial Intelligence Engineer
Artificial Intelligence Engineer

Optum • Hyderabad

Hybride
INR 1 500 000 - 2 100 000
AI or ML Engineer - Python, QA Testing
AI or ML Engineer - Python, QA Testing

Optum • Hyderabad

Sur place
INR 1 800 000 - 3 200 000
Senior Automation QA Engineer (AI & Playwright Focus)
Senior Automation QA Engineer (AI & Playwright Focus)

DIMAAG • Bengaluru Urban

Sur place
INR 1 200 000 - 1 800 000
Senior Software Quality Engineer - AI Assurance
Senior Software Quality Engineer - AI Assurance

Sysvine Technologies • Chennai

Sur place
INR 2 000 000 - 4 000 000