Data Architect

Confidential; Pune District, Pimpri-Chinchwad; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Confidential is seeking a highly experienced Data Architect (Grade 7B) to lead the design and delivery of enterprise Data & Insights on Microsoft Azure. The role emphasizes cloud data architecture, data models, lakehouse platforms, RAG pipelines, and Agentic AI, with governance via Purview.

Candidate should have hands-on Python, LangChain, LangGraph, and end-to-end SDLC experience across Azure data services, security, and CI/CD pipelines.

Qualifications

• 5+ years of experience delivering Azure-based data platforms.
• Strong Python, SQL, PySpark, and data modeling skills.
• Hands-on GenAI/RAG system design and governance experience.

Responsibilities

• Architect Azure data lake/lakehouse platforms, domain data models and ingestion-to-consumption pipelines.
• Design conceptual, logical, and physical cloud data models aligned with enterprise standards.
• Architect RAG pipelines with embeddings, vector stores, hybrid retrieval, reranking and evaluation.
• Build Agentic AI workflows using LangChain and LangGraph; design tool orchestration, memory, and safety layers.
• Implement governance with Microsoft Purview for cataloging, lineage, PII tagging and policy enforcement.
• Ensure platform security using Entra ID, private endpoints, VNETs, Key Vault and encryption controls.
• Lead solution architecture reviews, performance tuning, cost optimization and NFR engineering.
• Oversee CI/CD (Azure DevOps), IaC (Terraform/Bicep), and observability (Azure Monitor, App Insights).
• Mentor engineering teams and standardise best practices, patterns, and reusable components.

Skills

Python

PySpark

SQL

GenAI & Agentic AI

LangChain

LangGraph

Data Modeling

Azure data services

RAG pipelines

Embeddings

Education

Bachelor's/Master’s in CS/Engineering

Tools

Terraform

Bicep

Azure DevOps

Neo4j

Weaviate

Pinecone

Qdrant

Job description

Job Role: Data Architect – Data & Insights

Position Type: Full-time

Summary

We are looking for a highly experienced Data Architect (Grade 7B) to lead the design and delivery of the enterprise Data & Insights platform on Microsoft Azure. The role demands deep expertise in cloud data architecture, data models, data lake/lakehouse, vector-store based RAG systems, GenAI, Agentic AI, and governance using Microsoft Purview.

The ideal candidate has strong hands‑on skills in Python, LangChain, LangGraph, Azure data services, and end‑to‑end SDLC execution.

• Architect and design Azure‑based data lake/lakehouse platforms, domain data models, and ingestion‑to‑consumption pipelines.
• Develop conceptual, logical, and physical cloud data models aligned with enterprise standards.
• Architect RAG pipelines including embeddings, chunking, vector stores, hybrid retrieval, reranking, and evaluation.
• Build Agentic AI workflows using LangChain and LangGraph; design tool orchestration, memory, and safety layers.
• Implement governance with Microsoft Purview for cataloging, lineage, PII tagging, and policy enforcement.
• Ensure platform security using Entra ID, private endpoints, VNETs, Key Vault, and encryption controls.
• Lead solution architecture reviews, performance tuning, cost optimization, and NFR engineering.
• Oversee CI/CD (Azure DevOps), IaC (Terraform/Bicep), and observability (Azure Monitor, App Insights).
• Mentor engineering teams and standardise best practices, patterns, and reusable components.

Technical Skills

Mandatory

• Programming: Python, PySpark, SQL
• GenAI & Agentic AI: RAG architecture, vector stores (Azure Cognitive Search, Pinecone, Weaviate, Qdrant), embeddings, reranking
• Frameworks: LangChain, LangGraph
• Data Modeling: Conceptual/logical/physical models, Delta/Parquet patterns, lakehouse modelling
• Performance & Cost Optimization across compute, storage, vector workloads, and pipelines

Preferred

• dbt for transformations and testing
• Knowledge graphs (Neo4j) and graph‑based retrieval
• LLMOps: evaluation, telemetry, safety assessment, drift monitoring
• FinOps optimisation practices
• Multi‑cloud experience (AWS/GCP equivalents)

Qualifications

• Bachelor’s or Master’s degree in Engineering, Computer Science, or related discipline.
• Total experience with minimum 5+ years in cloud data architecture.
• Proven experience delivering Azure‑based data platforms and production‑grade GenAI/RAG systems.