Data Engineer: Azure Data Platform & AI-Driven Pipelines

TechDigital Group; Lansing (MI); On-site; USD 90,000 - 140,000; Full time

Job summary

TechDigital Group is seeking a data engineering professional to design and manage end-to-end data pipelines using Databricks, Azure Data Factory, and PySpark. You will craft data models and leverage Power BI for insights, aligning with modern lakehouse architectures.

The role emphasizes SQL proficiency, data normalization, and the use of Delta Lake/Iceberg formats, with cloud familiarity and a focus on scalable analytics solutions.

Qualifications

• Experience with data modeling and dimensional modeling techniques (Star Schema, Snowflake Schema).
• Hands-on with Azure data services for ETL/ELT pipelines and analytics.
• Familiarity with Databricks platforms and SQL-based analytics.

Responsibilities

• Design and implement data pipelines using Databricks, ADF, and Spark-based workflows.
• Build and maintain data models and dimensional schemas for analytics-ready data.
• Leverage Delta Lake/Iceberg open table formats and Azure services to enable scalable BI solutions.

Skills

Data Modeling

Tools

Microsoft Fabric

Azure Synapse Analytics

Azure Data Factory (ADF)

SQL

Power BI

Databricks

Databricks workflows

PySpark

Python

Databricks SQL

Job description

TechDigital Group is seeking a data engineering professional to design and manage end-to-end data pipelines using Databricks, Azure Data Factory, and PySpark. You will craft data models and leverage Power BI for insights, aligning with modern lakehouse architectures.

The role emphasizes SQL proficiency, data normalization, and the use of Delta Lake/Iceberg formats, with cloud familiarity and a focus on scalable analytics solutions.