Databricks AI & Governance

VDart Inc; Dallas (TX); Hybrid; USD 150,000 - 220,000; Part time

Job summary

VDart Inc. seeks an experienced professional to design and deploy Databricks AI & Governance solutions. You will build AI agents for data governance, cataloging, metadata management, and policy enforcement across enterprise platforms.

You will collaborate with engineers and stakeholders to validate use cases, deliver PoCs, and advance governance modernization initiatives leveraging LLMs and orchestration tools.

Qualifications

• Minimum 8+ years in Data Management, Data Governance, or Enterprise Data Architecture.
• 5+ years designing enterprise governance, MDM, metadata management, data quality or compliance.
• 3+ years building AI/ML or Agentic AI using LLMs and orchestration tools.
• 3+ years of Python and modern AI toolchains (LangChain, LangGraph, etc.).
• 3+ years with Azure, AWS, or Google Cloud Platform.
• 2+ years integrating governance platforms like Collibra or Databricks Unity Catalog.
• Experience defining governance policies, lineage, quality controls, and compliance.
• Experience in Agile delivery with backlog-driven development and stakeholder feedback.

Responsibilities

• Design, develop, and deploy Agentic AI solutions for governance workflows.
• Build scalable AI agents using LLMs, RAG, and orchestration frameworks.
• Collaborate with governance engineers, data engineers, and stakeholders.
• Develop autonomous and human-in-the-loop agents for cataloging and policy checks.
• Integrate AI agents with data catalogs, metadata repos, QI tools, and cloud platforms.
• Create PoV demonstrations and pilots to validate automation opportunities.
• Refine governance backlogs and onboard controls enterprise-wide.
• Implement monitoring, guardrails, and compliance for governance solutions.
• Support proposals, architecture discussions, and client demos.
• Contribute to reusable frameworks and accelerators.

Skills

AI Governance

Data Governance

Cloud Platforms

Python

APIs

Agile Delivery

Stakeholder Engagement

LLMs / Agentic AI

Tools

LangChain

LangGraph

Semantic Kernel

AutoGen

CrewAI

OpenAI

Azure AI Foundry

Amazon Bedrock

Job description

Title: Databricks AI & Governance

Location: Dallas,TX, Chicago,IL, Charlotte,NC, San Francisco,CA (Hybrid)

Type: Contract

Day to Day Job Duties:

• Design, develop, and deploy Agentic AI solutions that automate data governance, data quality, metadata management, lineage analysis, policy enforcement, and stewardship workflows across enterprise data platforms.
• Build scalable AI agents leveraging Large Language Models (LLMs), Retrieval Augmented Generation (RAG), orchestration frameworks, and enterprise governance tools to support data management and regulatory compliance initiatives.
• Partner with Data Governance Engineers, Data Engineers, Architects, and business stakeholders to rapidly discover governance use cases, define agent capabilities, and align solution architecture with enterprise data strategy.
• Develop and maintain autonomous and human-in-the-loop agents that assist with data cataloging, business glossary management, policy compliance validation, data ownership assignment, issue remediation, and governance workflow orchestration.
• Integrate AI agents with enterprise platforms including data catalogs, metadata repositories, data quality tools, MDM platforms, cloud data platforms, and governance technologies such as Ataccama, Collibra, Informatica, Microsoft Purview, Databricks, Snowflake, AWS, and Azure.
• Create proof-of-value demonstrations and pilot implementations to validate governance automation opportunities and accelerate stakeholder adoption.
• Collaborate with internal delivery teams and client stakeholders to continuously refine governance backlogs, prioritize agent development initiatives, and incrementally onboard governance controls across the enterprise.
• Implement monitoring, observability, guardrails, and governance controls for Agentic AI solutions to ensure security, compliance, transparency, and responsible AI practices.
• Support proposal development, solution architecture discussions, effort estimation, and client presentations related to Data & AI governance modernization initiatives.
• Contribute to reusable frameworks, accelerators, and best practices for enterprise-scale Agentic AI implementations focused on data governance and management.

Basic Qualifications:

• Minimum 8+ years of experience in Data Management, Data Engineering, Data Governance, Metadata Management, or Enterprise Data Architecture.
• Minimum 5+ years of experience designing and implementing enterprise data governance, master data management (MDM), metadata management, data quality, or regulatory compliance solutions.
• Minimum 3+ years of experience developing AI/ML, Generative AI, or Agentic AI solutions using LLMs and orchestration frameworks.
• Minimum 3+ years of hands‑on experience with Python and modern AI development frameworks such as LangChain, LangGraph, Semantic Kernel, AutoGen, CrewAI, OpenAI, Azure AI Foundry, Amazon Bedrock, or equivalent platforms.
• Minimum 3+ years of experience working with cloud platforms including Azure, AWS, or Google Cloud Platform.
• Minimum 2+ years of experience integrating governance platforms such as Collibra, Databricks Unity Catalog, or related data management technologies.
• Minimum 2+ years of experience designing APIs, workflow orchestration, event‑driven architectures, or enterprise system integrations.
• Experience defining governance policies, lineage workflows, data quality controls, stewardship processes, and compliance monitoring capabilities.
• Experience working in Agile delivery environments with backlog-driven development, iterative releases, and stakeholder feedback cycles.
• Strong client‑facing communication skills with the ability to lead workshops, requirements gathering sessions, architecture reviews, and executive demonstrations.