Azure Databricks & Agentic AI Architect

CIS Technologies Inc.; United States; Remote; USD 180,000 - 280,000; Full time

Job summary

CIS Technologies Inc. is seeking an Azure Databricks & Agentic AI Architect to design and lead next-generation AI-powered data platforms for enterprise-scale needs.

The role requires 15 years in Data & Analytics with hands-on Azure Databricks, Lakehouse, Delta Lake, Unity Catalog, ADLS Gen2, and Azure OpenAI, Generative AI, and Agentic AI expertise.

You will mentor teams, drive AI-driven data engineering, and partner with CXO stakeholders to deliver measurable business value.

Qualifications

• 15 years of Data & Analytics experience.
• Hands-on Azure Databricks and Lakehouse expertise.
• Deep knowledge of Delta Lake, Unity Catalog, and ADLS Gen2.
• Proficiency in PySpark, Spark SQL, Python & SQL.
• Experience with Generative AI, Agentic AI, and AI-driven data engineering.

Responsibilities

• Design enterprise-scale Azure Databricks Lakehouse platforms.
• Lead Agentic AI implementations for autonomous data ingestion and orchestration.
• Develop AI-DLC solutions covering modeling, testing, and deployment.
• Architect RAG-based GenAI solutions using enterprise data.
• Define AI governance, security, and cost monitoring.
• Mentor architects, data engineers, and AI engineers.
• Communicate AI strategy to senior stakeholders.

Skills

Data & Analytics experience

Azure Databricks

Lakehouse Architecture

Delta Lake

Unity Catalog

ADLS Gen2

Azure Data Factory

PySpark

Spark SQL

Python

SQL

Azure OpenAI

Generative AI

Agentic AI

RAG Architecture

LangChain

LangGraph

MCP Protocol

AI Agent Orchestration

Vector Databases

Knowledge Graphs

Azure DevOps

CI/CD

MLOps

LLMOps

AI Testing

Tools

Databricks

Delta Lake

Unity Catalog

ADLS Gen2

Azure Data Factory

PySpark

Spark SQL

Python

SQL

Azure OpenAI

LangChain

LangGraph

MCP Protocol

Vector Databases

Knowledge Graphs

Azure DevOps

CI/CD

Job description

Title: Azure Databricks & Agentic AI Architect

Location: Remote

Job Description

We are looking for a highly experienced Azure Databricks & Agentic AI Architect to design and lead next-generation AI-powered data platforms. The ideal candidate will have 15 years of Data & Analytics experience, strong Azure Databricks/Lakehouse expertise, and hands-on experience with Generative AI, Agentic AI, and AI-driven Data Engineering.

Key Responsibilities

Design enterprise-scale Azure Databricks Lakehouse platforms using Delta Lake, Unity Catalog, ADLS Gen2, Databricks Workflows, and Delta Live Tables.

Lead the implementation of Agentic AI for autonomous data ingestion, mapping, transformation, data quality, metadata enrichment, lineage, testing, and pipeline optimization.

Design AI-driven Data Development Lifecycle (AI-DLC) solutions covering requirements, data modeling, code generation, testing, documentation, deployment, and monitoring.

Architect RAG-based GenAI solutions using enterprise data.

Design AI agent orchestration using Azure OpenAI, LangGraph, LangChain, Semantic Kernel, AutoGen, and MCP.

Build domain-specific AI agents for Data Engineering and Analytics teams.

Design self-healing data pipelines and AI-driven incident triage, failure prediction, SLA monitoring, capacity planning, and cost optimization.

Establish Human-in-the-Loop (HITL) frameworks and governance for autonomous AI agents.

Define enterprise AI governance covering security, observability, auditability, prompt governance, cost monitoring, and responsible AI.

Mentor architects, data engineers, and AI engineers.

Lead enterprise architecture discussions and communicate AI strategy and business value to senior/CXO stakeholders.

Required Skills

15 years of Data & Analytics experience, Strong hands-on Azure Databricks, Lakehouse Architecture, Delta Lake & Unity Catalog, ADLS Gen2, Azure Data Factory, PySpark, Spark SQL, Python & SQL, Azure OpenAI, Generative AI & Agentic AI, RAG Architecture, LangChain / LangGraph, MCP Protocol, AI Agent Orchestration, Vector Databases / Knowledge Graphs, Azure DevOps & CI/CD

MLOps / LLMOps, AI Testing & Evaluation Frameworks

Preferred Skills

Databricks Certified Data Engineer Professional, Databricks Certified Solution Architect, Azure Solutions Architect Expert (AZ-305), Azure Data Engineer (DP-203)

Azure OpenAI / Generative AI certifications, Experience leading enterprise AI transformation initiatives, Strong executive and client-facing communication skills