Generative AI Developer - Senior Associate

PwC Acceleration Center India; Bengaluru; On-site; INR 2,500,000 - 5,000,000; Full time

Job summary

PwC Acceleration Center India in Bengaluru seeks a Senior Associate – Generative AI Developer to design, develop, and test end-to-end GenAI applications. You will work with LLM APIs, RAG pipelines, prompt engineering, and multi-agent frameworks to deliver production-grade AI solutions.

The role requires hands-on experience in testing, monitoring, and optimizing GenAI models, with exposure to enterprise data sources and cloud platforms.

Qualifications

• 5+ years total IT experience with 2–3 years in AI/ML or Generative AI.
• Hands-on experience building, testing, deploying LLM-based or agentic AI apps in production or pilot settings.
• Experience with end-to-end GenAI solutions, including testing, performance monitoring, and optimization.

Responsibilities

• Design, develop, and test end-to-end Generative AI and agentic AI applications.
• Work with LLM APIs, RAG pipelines, prompt engineering, and multi-agent frameworks.
• Establish automated and manual testing pipelines using TruLens, LangSmith, PromptLayer, or DeepEval.
• Monitor performance and optimize prompts, retrieval logic, and memory systems.
• Collaborate with architects, data scientists, UI/UX engineers, and product managers.
• Stay updated with new model releases and GenAI frameworks.

Skills

Python

LangChain

LlamaIndex

CrewAI

LangGraph

LLM architectures

Tools

OpenAI API

Azure OpenAI

Anthropic

Cohere

FAISS

Pinecone

Chroma

Milvus

Job description

Job Title: Senior Associate – Generative AI Developer

Experience 5+ years of total IT experience, including 2–3 years in AI/ML or Generative AI development. Must have hands-on experience building, testing, and deploying LLM-based or agentic AI applications in production or pilot settings.

Role Overview

The Senior Associate – Generative AI Developer will design, develop, and rigorously test end-to-end Generative AI and agentic AI applications. This role requires hands-on expertise with LLM APIs, RAG pipelines, prompt engineering, and multi-agent frameworks, combined with a disciplined approach to testing, performance monitoring, and optimization.

Key Responsibilities

• LLM & GenAI Development: Design, develop, and maintain LLM-powered applications using APIs such as OpenAI, Azure OpenAI, Anthropic, or Cohere. Implement core GenAI workflows including summarization, classification, Q&A, and content generation.


• Agentic AI Implementation: Build and orchestrate multi-agent systems using frameworks like CrewAI, LangGraph, OpenAI Agents SDK, or Azure AI Agent Framework. Implement inter-agent communication, task routing, and tool orchestration for complex workflows.


• RAG & Embedding Pipelines: Implement retrieval-augmented generation pipelines involving embedding creation, chunking, and vector indexing using FAISS, Pinecone, Chroma, or Milvus. Ensure efficient retrieval for context-aware outputs.


• Prompt Engineering & Techniques: Apply advanced prompting strategies such as Few-Shot Learning, Chain-of-Thought (CoT), ReAct, and CART to improve reliability and interpretability of model responses.


• Testing & Validation: Establish automated and manual testing pipelines using TruLens, LangSmith, PromptLayer, or DeepEval to evaluate model quality, accuracy, safety, and factual grounding. Define and track metrics such as coherence, hallucination rate, and response diversity.


• Performance Monitoring & Optimization: Implement cost-effective token management and model observability using logging and tracing frameworks. Continuously optimize prompts, retrieval logic, and memory mechanisms to improve efficiency.


• Data Analysis & Preparation: Conduct EDA and pre-processing of textual datasets to ensure quality input for training, evaluation, and fine-tuning tasks.


• Documentation & Collaboration: Create detailed design documents, maintain experiment logs, and collaborate with architects, data scientists, UI/UX engineers, and product managers to ensure solution alignment with business goals.


• Continuous Learning: Stay up to date with new model releases (OpenAI GPT, Claude, Gemini, Mistral, LLaMA, etc.) and frameworks in the GenAI and agentic AI ecosystem.

Key Skills & Competencies

• Strong proficiency in Python, LangChain, LlamaIndex, CrewAI, and LangGraph


• Deep understanding of LLM architectures, tokenization, embedding models, and vector databases


• Experience with prompt testing and evaluation frameworks (TruLens, LangSmith, PromptLayer, DeepEval)


• Familiarity with bias mitigation, safety testing, and Responsible AI principles


• Knowledge of MLOps/LLMOps practices for deploying and monitoring AI models


• Strong analytical mindset, documentation discipline, and collaborative approach


• Exposure to at least one major cloud AI platform (Azure, AWS, GCP, or OCI)

Preferred Background

• Prior experience in building chatbots, intelligent assistants, summarizers, or document automation solutions using LLMs


• Familiarity with open-weight model experimentation (LLaMA, Mistral, Falcon, etc.)


• Exposure to multi-modal AI (text, image, code) and integration with enterprise data sources


• Experience supporting GenAI projects through testing, benchmarking, and performance optimization