Azure Data Engineer: Synapse, Databricks & PySpark Expert

TechDigital Group; Jackson (MI); On-site; USD 90,000 - 140,000; Full time

Job summary

TechDigital Group in Michigan is seeking a hands-on Data Engineer proficient with Azure Synapse Analytics, Data Factory, and Databricks to design and operate robust data pipelines. You will work with PySpark, Pandas, NumPy, and SQL to transform, integrate, and load data from APIs and various sources.

The role involves deploying code through CI/CD, collaborating with BI tools like Power BI, and supporting data quality across the landscape. On-site position in Michigan with growth opportunities.

Qualifications

• Hands-on experience with Azure Synapse Analytics, Azure Data Factory and Databricks.
• Proficient in Python libraries: PySpark, Pandas, NumPy.
• Experience with APIs and data retrieval/processing.
• Hands-on deployment via GitHub and CI/CD pipelines for data projects.
• Strong skills in SQL, stored procedures and data orchestration.

Skills

Data integration

SQL

Python

CI/CD

API integration

Power BI

Tools

Azure Synapse Analytics

Azure Data Factory

Azure Databricks

Azure Storage

Azure Key Vault

SQL Pool CI/CD

Functions

Logic Apps

Linked services

Runtimes

Datasets

Pipelines

Activities

Notebooks

PySpark

Pandas

NumPy

MySQL

Oracle

Job description

TechDigital Group in Michigan is seeking a hands-on Data Engineer proficient with Azure Synapse Analytics, Data Factory, and Databricks to design and operate robust data pipelines. You will work with PySpark, Pandas, NumPy, and SQL to transform, integrate, and load data from APIs and various sources.

The role involves deploying code through CI/CD, collaborating with BI tools like Power BI, and supporting data quality across the landscape. On-site position in Michigan with growth opportunities.