LLM Evaluation Lead (Applied Scientist)

Tekskills Inc.; Bengaluru; In loco; INR 400.000 - 650.000; Tempo pieno

Descrizione del lavoro

Tekskills Inc. in Bengaluru seeks a Senior Generative AI Engineer who can lead building enterprise Gen AI solutions. You will design and deploy LLM-based systems, work on RAG pipelines, prompt engineering, and knowledge management, and mentor junior engineers.

The role requires strong coding skills, clear communication with stakeholders, and the ability to scale AI solutions securely across complex workflows.

Competenze

• Deep understanding of LLM behavior and failure modes.
• Prompt sensitivity and RAG failure analysis.
• Evaluation strategy ownership (offline & online).
• Experience with Ragas, DeepEval, TruLens.

Mansioni

• Design and develop Generative AI and LLM-based solutions.
• Implement RAG pipelines, AI agents, prompt engineering, and knowledge systems.
• Integrate Gen AI models with enterprise applications and workflows.
• Lead technical design and mentor junior team members.
• Work with stakeholders to identify and implement AI use cases.
• Ensure scalability, security, and performance of AI solutions.

Conoscenze

LLM behavior

Prompt engineering

RAG pipelines

Adversarial prompts

Knowledge systems

Evaluation strategy

Security & scalability

DataScience-Product bridge

Strumenti

Ragas

DeepEval

TruLens

Descrizione del lavoro

Job Summary

We are looking for a Senior Generative AI Engineer with strong hands‑on experience in AI/ML and LLM technologies. The role requires excellent communication, leadership skills, and deep coding expertise to build and deploy enterprise Gen AI solutions.

Key Responsibilities

• Design and develop Generative AI and LLM-based solutions
• Implement RAG pipelines, AI agents, prompt engineering, and knowledge systems
• Integrate Gen AI models with enterprise applications and workflows
• Lead technical design and mentor junior team members
• Work with stakeholders to identify and implement AI use cases
• Ensure scalability, security, and performance of AI solutions

Key Skills

• Deep understanding of LLM behavior & failure modes
• Prompt sensitivity, hallucination analysis, RAG failure modes
• Evaluation strategy ownership (offline & online)
• Tools: Ragas, DeepEval, TruLens
• Red‑teaming & adversarial prompt design
• Vendor model comparison tracking
• Bridge between Data Science & Product