LLM Evaluation Lead (Applied Scientist)

Tekskills; Gurugram District; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Tekskills in Gurugram, India, seeks a Senior Generative AI Engineer with deep hands-on AI/ML and LLM expertise to design, build, and deploy enterprise Gen AI solutions.

You will lead architecture, implement RAG pipelines, prompt engineering, and knowledge systems, mentor engineers, and collaborate with stakeholders to drive high-impact use cases while ensuring scalability and security.

Qualifications

• Strong hands-on experience with AI/ML and LLMs; deployment of Gen AI solutions.
• Experience building enterprise Gen AI solutions and scalable systems.
• Ability to design and evaluate Gen AI use cases with stakeholders.

Responsibilities

• Design and develop Generative AI and LLM-based solutions.
• Implement RAG pipelines, AI agents, prompt engineering, and knowledge systems.
• Integrate Gen AI models with enterprise applications and workflows.
• Lead technical design and mentor junior team members.
• Work with stakeholders to identify and implement AI use cases.
• Ensure scalability, security, and performance of AI solutions.

Skills

LLM behavior

Prompt sensitivity

Evaluation strategy

Red-teaming

Vendor model comparison

Data Science & Product bridge

RAG failure modes

Tools

Ragas

DeepEval

TruLens

Job description

Job Summary

We are looking for a Senior Generative AI Engineer with strong hands-on experience in AI/ML and LLM technologies. The role requires excellent communication, leadership skills, and deep coding expertise to build and deploy enterprise Gen AI solutions.

Key Responsibilities

• Design and develop Generative AI and LLM-based solutions
• Implement RAG pipelines, AI agents, prompt engineering, and knowledge systems
• Integrate Gen AI models with enterprise applications and workflows
• Lead technical design and mentor junior team members
• Work with stakeholders to identify and implement AI use cases
• Ensure scalability, security, and performance of AI solutions

Key Skills

• Deep understanding of LLM behavior & failure modes
• Prompt sensitivity, hallucination analysis, RAG failure modes
• Evaluation strategy ownership (offline & online)
• Tools: Ragas, DeepEval, TruLens
• Red-teaming & adversarial prompt design
• Vendor model comparison tracking
• Bridge between Data Science & Product