Generative AI Engineer

Nomiso; Hyderabad; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Nomiso is seeking a GenAI Expert in Hyderabad who can design, build and productionize AI systems—from architecture to deployment—while embedding a strong quality layer.

You will own RAG pipelines, evaluate models, implement test automation across unit to performance tests, and establish CI/CD gates, telemetry and monitoring to ensure reliable, scalable GenAI solutions.

Qualifications

• 8+ years overall experience combining GenAI and QA/Test Automation.
• 4+ years hands-on experience building GenAI/LLM solutions.
• 5+ years strong experience in QA, testing and automation.
• Hands-on expertise with RAG, LLM APIs, vector databases, prompt engineering and model evaluation.
• Experience with OpenAI, Anthropic, Hugging Face, Pinecone, Weaviate or FAISS.
• Strong automation experience with PyTest, Jest, Selenium, Cypress or similar.
• Experience with LLM evaluation, hallucination testing, model regression, bias testing and A/B testing.
• Strong understanding of accuracy vs latency vs cost trade-offs.
• Builder mindset with strong ownership and ability to operate independently.

Responsibilities

• Build and ship production-grade LLM/RAG applications and AI agents.
• Design AI testing and evaluation strategies for accuracy, reliability, hallucinations, bias and non-deterministic outputs.
• Develop test automation across unit, integration, E2E, regression and performance.
• Optimize models, prompts, retrieval, inference, latency and cost.
• Establish AI quality gates, CI/CD automation, telemetry and production monitoring.
• Experiment, measure and continuously improve AI performance.
• Mentor engineers and drive GenAI engineering & quality best practices.

Skills

GenAI

QA / Test Automation

RAG

LLM Solutions

Prompt Engineering

Model Evaluation

OpenAI

Anthropic

Hugging Face

A/B Testing

Latency vs Cost

Independent Ownership

Tools

PyTest

Jest

Selenium

Cypress

Pinecone

Weaviate

FAISS

LLM APIs

Vector Databases

CI/CD

Job description

We’re looking for a GenAI Expert who can build AI systems—and break them before production does.

This is a high-impact IC role at the intersection of Generative AI, AI Engineering and Quality Engineering. You’ll own the complete lifecycle: architect → build → test → deploy → measure → improve.

If you’re equally comfortable designing a RAG pipeline and designing the test strategy that proves it works, this role is for you.

What You’ll Own

• Build and ship production-grade LLM/RAG applications and AI agents.
• Design AI testing and evaluation strategies for accuracy, reliability, hallucinations, bias and non-deterministic outputs.
• Develop test automation across unit, integration, E2E, regression and performance.
• Optimize models, prompts, retrieval, inference, latency and cost.
• Establish AI quality gates, CI/CD automation, telemetry and production monitoring.
• Experiment, measure and continuously improve AI performance.
• Mentor engineers and drive GenAI engineering & quality best practices.

What You Bring

• 8+ years overall experience, combining strong GenAI and QA/Test Automation expertise.
• 4+ years hands‑on experience building/shipping GenAI/LLM solutions.
• 5+ years strong experience in QA, testing and automation.
• Hands‑on expertise with RAG, LLM APIs, vector databases, prompt engineering and model evaluation.
• Experience with OpenAI / Anthropic / Hugging Face, Pinecone / Weaviate / FAISS.
• Strong automation experience with PyTest, Jest, Selenium, Cypress or similar.
• Experience with LLM evaluation, hallucination testing, model regression, bias testing and A/B testing.
• Strong understanding of accuracy vs. latency vs. cost trade-offs.
• A builder mindset with strong ownership and the ability to operate independently.

Why This Role?

This isn't traditional QA.

This isn't just GenAI experimentation.

You’ll build AI systems—and engineer the quality layer that makes them production-ready.

If you’re excited about AI + Automation + Quality at scale, we want to hear from you.