Large Language Model Architect | AI / GenAI / Databricks

Mount Talent Consulting; Pune District, Mumbai, Bengaluru; On-site; INR 4,000,000 - 8,000,000; Full time

Job summary

Mount Talent Consulting seeks an experienced AI Architect to lead enterprise-scale AI platforms. You will shape target architecture with CIOs and business leaders, focusing on LLMs, generative AI, RAG and agentic systems across cloud platforms.

The role demands 15+ years of IT experience, hands-on Databricks/Mosaic AI work, and governance, security and observability expertise for scalable, production-grade solutions.

Qualifications

• 15+ years of IT experience with architecture focus.
• Expert in LLMs and Generative AI.
• Hands-on architecture with Databricks / Mosaic AI.
• Strong knowledge of RAG, embeddings, vector databases and context engineering.
• Experience with Agentic AI / Multi-Agent architecture and orchestration.
• Familiar with MLflow, Vector Search, Unity Catalog, Delta Lake and model serving.
• Experience designing enterprise AI solutions on major cloud platforms.
• Understanding of AI security, governance, privacy, observability, scalability and NFRs.
• Proven ability to engage executives and translate business objectives into roadmaps.

Responsibilities

• Define end-to-end enterprise AI architecture covering ML, Generative AI, LLM apps, RAG and agentic AI.
• Lead modernization on Databricks Lakehouse and Mosaic AI initiatives.
• Design governed RAG and multi-agent architectures using Delta Lake and Unity Catalog.
• Define architecture for LLM apps, model serving, evaluation, monitoring and observability.
• Architect multi-agent systems, orchestration, tool calling, memory and AI gateway patterns.
• Design context engineering with knowledge graphs, semantic retrieval and vector search.
• Establish security, governance, privacy, scalability, performance and cost norms.
• Drive model routing, inference optimization, fine-tuning and production deployment.
• Create ADRs, reference architectures and governance frameworks; engage senior stakeholders.

Skills

LLM

Generative AI

Databricks

RAG

Agentic AI

Cloud platforms

Enterprise architecture

Security & governance

Education

15 years education

Tools

Databricks/Mosaic AI

MLflow

Delta Lake

Unity Catalog

Vector Search

Job description

Large Language Model Architect | AI / GenAI / Databricks

Experience: 15+ Years
Education: 15 Years Full-Time Education
Role: Large Language Model Architect

About the Role

We are looking for a highly experienced AI / LLM Architect to lead the design and architecture of enterprise-scale AI platforms and solutions. The ideal candidate will be a technical authority in LLM, Generative AI, RAG, Agentic AI and Databricks, with strong experience in enterprise architecture, cloud platforms and production-grade AI implementations.

The role involves working closely with CIOs, CTOs, business leaders, architects and engineering teams to define AI strategy, target architecture and implementation roadmaps.

Key Responsibilities

• Define end-to-end enterprise AI architecture covering Machine Learning, Generative AI, LLM applications, RAG and Agentic AI.
• Lead architecture and modernization initiatives on Databricks Lakehouse and Mosaic AI.
• Design governed RAG and multi-agent architectures using Delta Lake, Unity Catalog, Vector Search and Mosaic AI.
• Define architecture for LLM applications, model serving, evaluation, monitoring and observability.
• Architect enterprise-grade multi-agent systems, orchestration, tool calling, memory and AI gateway/control-plane patterns.
• Design context engineering solutions covering knowledge graphs, ontologies, semantic retrieval, vector search and conversation state.
• Establish standards for security, governance, privacy, scalability, performance, reliability and cost optimization.
• Drive architecture for model routing, inference optimization, fine-tuning, caching and production deployment.
• Define and implement AI evaluation and observability frameworks covering accuracy, relevance, groundedness, latency, quality, cost and safety.
• Create architecture blueprints, ADRs, sequence diagrams, reference architectures, design specifications and governance frameworks.
• Engage with senior stakeholders to translate business objectives into practical AI technology roadmaps.

Mandatory Skills

• 15+ years of overall IT experience with strong architecture experience.
• Strong expertise in Large Language Models (LLMs) and Generative AI.
• Hands-on architecture experience with Databricks / Mosaic AI.
• Strong experience in RAG, embeddings, vector databases, semantic retrieval and context engineering.
• Experience with Agentic AI / Multi-Agent architecture, tool calling and orchestration.
• Strong knowledge of MLflow, Vector Search, Unity Catalog, Delta Lake and Model Serving.
• Experience designing enterprise-grade AI solutions on at least one major cloud platform.
• Strong understanding of AI security, governance, privacy, observability, scalability and NFRs.
• Experience working with senior/executive stakeholders and leading enterprise architecture initiatives.
• Experience in one or more industries such as Financial Services, Healthcare, Manufacturing, Retail, Telecom or Life Sciences.

Good to Have

• Databricks Machine Learning Professional / Data Engineer Professional / Generative AI certification.
• Experience with Spark/PySpark, Delta Live Tables, Databricks Workflows and Jobs.
• Exposure to LangChain, LangGraph, LlamaIndex, Haystack or Semantic Kernel.
• Experience with FastAPI, Docker and Kubernetes.
• Knowledge of Responsible AI, Model Risk Management, Red Teaming, Human-in-the-Loop and GenAI FinOps.
• Experience with model fine-tuning and lakehouse performance optimization.
• Strong thought leadership through architecture accelerators, whitepapers, client advisory or AI capability building.

Educational Qualification

15 years of full-time education is mandatory.