Senior Generative AI Architect

Coforge; Hyderabad; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

Coforge is seeking a Senior Generative AI Architect to lead the design, development, and deployment of generative AI solutions that align with business goals. You will oversee LLM orchestration, RAG integrations, and agent workflows across cloud and on-prem environments.

The role requires deep expertise in LangChain/LangGraph, RAG pipelines, vector DBs, and AI ethics, with collaboration across data science, ML engineering, and product teams to deliver scalable, secure, and compliant AI systems.

Qualifications

• Minimum of 7+ years of experience in AI/ML architecture or a related role.

Responsibilities

• Develop and maintain the architectural framework for generative AI and LLM-powered solutions, ensuring alignment with business goals and technical standards.
• Lead the design, fine-tuning, and deployment of generative AI models and LLM-based applications for use cases such as content generation, automation, copilots, and decision support systems.
• Design and implement LLM orchestration pipelines using frameworks such as LangChain, LangGraph, Semantic Kernel, or similar tools; build agentic workflows and multi-step reasoning pipelines.
• Architect and implement Retrieval-Augmented Generation (RAG) pipelines using vector databases and embedding models; enable enterprise knowledge integration.
• Collaborate with software engineering teams to integrate AI capabilities into existing applications and enterprise workflows.
• Ensure AI/LLM solutions are scalable, latency- and cost-optimized, and production-ready across cloud and hybrid environments.
• Implement and enforce ethical guidelines for AI development, including bias mitigation, explainability, safety guardrails, and responsible AI practices.
• Create comprehensive documentation for AI architectures, LLM workflows, prompt templates, and governance standards.

Skills

Generative AI

LLM architecture

LangChain

LangGraph

RAG pipelines

Prompt engineering

Python

Java

C++

AI/machine learning

Tools

TensorFlow

PyTorch

Hugging Face

FAISS / vector DBs

AWS

Azure

GCP

Job description

Job Summary:

The Senior Generative AI Architect will be responsible for designing, developing, and implementing generative AI solutions that align with the company's strategic objectives. This role involves leading the architecture and deployment of advanced AI models, including LLM-based systems and agentic workflows, ensuring scalability, security, and ethical considerations are integrated into all AI initiatives. The ideal candidate will possess deep expertise in generative AI technologies, LLM orchestration frameworks (e.g., LangChain, LangGraph), a strong understanding of AI ethics, and the ability to collaborate effectively with cross-functional teams.

Key Responsibilities:

• Develop and maintain the architectural framework for generative AI and LLM-powered solutions (including RAG, agents, and multi-step workflows), ensuring alignment with business goals and technical standards.
• Lead the design, fine-tuning, and deployment of generative AI models (e.g., GPT, DALL-E, Stable Diffusion) and LLM-based applications for use cases such as content generation, automation, copilots, and decision support systems.

LLM Orchestration & Agent Design:

• Design and implement LLM orchestration pipelines using frameworks such as LangChain, LangGraph, Semantic Kernel, or similar tools. Build agentic workflows, tool-augmented agents, and multi-step reasoning pipelines.

RAG & Knowledge Systems:

• Architect and implement Retrieval-Augmented Generation (RAG) pipelines using vector databases (e.g., FAISS, Pinecone, Azure AI Search) and embedding models to enable enterprise knowledge integration.

Integration:

• Collaborate with software engineering teams to integrate generative AI capabilities, LLM services, and autonomous agents into existing applications, APIs, and enterprise workflows.

Scalability & Performance:

• Ensure AI/LLM solutions are scalable, optimized for latency and cost, and production-ready across cloud and hybrid environments.

Ethical AI Practices:

• Implement and enforce ethical guidelines for AI development, including bias mitigation, explainability, safety guardrails, and responsible AI practices in LLM deployments.
• Stay abreast of advancements in LLMs, prompt engineering, agent frameworks, multimodal AI, and GenAI tooling, incorporating emerging techniques into the AI strategy.
• Work closely with data scientists, ML engineers, product teams, and stakeholders to identify AI-driven opportunities and ensure successful delivery.

Documentation & Standards:

• Create comprehensive documentation for AI architectures, LLM workflows, prompt templates, and best practices. Establish coding, evaluation, and governance standards.

Experience:

• Minimum of 7+ years of experience in AI/ML architecture or a related role.
• Proven experience in designing and deploying Generative AI and LLM-based solutions in production.
• Hands‑on experience with LangChain, LangGraph, or similar orchestration frameworks for building LLM pipelines and agent systems.
• Experience in building RAG pipelines, vector database integration, and prompt engineering techniques.
• Strong experience with AI frameworks/tools such as TensorFlow, PyTorch, Hugging Face.
• Experience with cloud platforms (AWS, Azure, GCP) and deploying scalable AI/LLM solutions.

Technical Skills:

• Proficiency in programming languages such as Python (preferred), Java, or C++
• Strong expertise in LLMs, prompt engineering, embeddings, and fine‑tuning techniques
• Hands‑on experience with:
• LangChain, LangGraph / Agent frameworks
• Strong understanding of machine learning and deep learning concepts