Lead Azure Databricks Data Engineer

VDart Inc; Cincinnati (OH); On-site; USD 120,000 - 170,000; Full time

Job summary

VDart Inc. seeks a senior data engineer/architect to design and implement scalable data solutions on Microsoft Azure, including Databricks and Data Factory. You will work with Spark, Kafka, SQL, and Python to deliver end-to-end data warehouses and data marts.

Leadership and mentoring experience are required, with CI/CD practices across GitHub Actions and Azure Pipelines. Familiarity with Data Vault, dimensional modeling, and OLAP is advantageous.

Qualifications

• Experience architecting and implementing data solutions on Azure with Databricks and ADF.
• Strong data engineering skills: Spark, Kafka, SQL, Python.
• Hands-on with end-to-end data warehouses and data marts.
• Knowledge of Data Vault, dimensional modeling, OLAP.

Responsibilities

• Lead data engineering initiatives and mentor engineers in a fast-paced environment.
• Design scalable data platforms and ensure robust CI/CD practices.

Skills

Azure

Azure Databricks

Azure Data Factory

Apache Spark

Kafka

SQL

Python

Data warehouse

Data mart

Data Vault

Dimensional modeling

OLAP design

Distributed systems

GitHub Actions

Azure Pipelines

Team leadership

Mentoring

Problem solving

Retail data

Vector search

Semantic retrieval

Relational modeling

Unstructured data modeling

Observability

Dev containers

Unit testing

Code quality

Linting

Agile

Stakeholder management

Global delivery

Automation

Generative AI

Job description

VDart Inc. seeks a senior data engineer/architect to design and implement scalable data solutions on Microsoft Azure, including Databricks and Data Factory. You will work with Spark, Kafka, SQL, and Python to deliver end-to-end data warehouses and data marts.

Leadership and mentoring experience are required, with CI/CD practices across GitHub Actions and Azure Pipelines. Familiarity with Data Vault, dimensional modeling, and OLAP is advantageous.