Azure Data Engineer – Synapse, ADF & Databricks

ITMC Systems, Inc; Jackson (MI); Hybrid; USD 110,000 - 150,000; Full time

Job summary

ITMC Systems, Inc. is seeking a Data Engineer to design and maintain end-to-end data pipelines using Azure Data Factory, Synapse, and Databricks in a Hybrid Jackson, MI environment.

The role focuses on PySpark/Python development for delta loads, complex SQL procedures, and API data ingestion, with GitHub CI/CD deployments and Power BI integration. Collaboration across analytics teams is required.

Qualifications

• Advanced Python and PySpark programming skills with API ingestion and delta loads.
• High proficiency in writing complex SQL stored procedures and dynamic SQL.
• Hands-on experience with GitHub/DevOps and CI/CD deployment pipelines.
• Familiarity with Power BI and data visualization concepts.
• Hybrid work availability: 3 days onsite per week in Jackson, MI.

Responsibilities

• Design, construct, and maintain end-to-end data integration pipelines using Azure data services.
• Build complex pipeline orchestrations with control flows, lookups, data flows, and functions.
• Write, test, and debug high-performance PySpark and Python code for data processing.
• Ingest data from external REST APIs and relational databases (Oracle, MySQL, SQL Server).
• Manage automated code deployments across Dev → QA → Prod with CI/CD.

Skills

Python

PySpark

API ingestion

Delta loads

T-SQL / dynamic SQL

GitHub/DevOps

CI/CD pipelines

Power BI

Tools

Azure Data Factory

Azure Synapse Analytics

Azure Databricks

Power BI

SQL Server / Oracle / MySQL

GitHub

Job description

Location: Jackson, MI (Hybrid - 3 days/week onsite)

Role Overview & Key Responsibilities:

• Design, construct, and maintain end-to-end data integration pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Databricks.
• Build complex pipeline orchestrations incorporating control flows (For Each, If, Switch, Until), Lookups, Data Flows, and Azure Functions.
• Write, test, and debug high-performance PySpark and Python code using libraries such as Pandas and NumPy for delta loads and data processing.
• Author advanced T-SQL code, dynamic SQL, stored procedures, and user-defined functions within SQL Pools.
• Extract and ingest data from external REST APIs and relational databases (Oracle, MySQL, SQL Server).
• Manage automated code deployments across landscape environments (Dev -> QA -> Prod) using GitHub and CI/CD pipelines.
• Install Python libraries, troubleshoot cluster issues, and collaborate with analytics teams on Power BI integrations.

Required Qualifications & Skills:

• Advanced Python and PySpark programming skills with direct experience handling API ingestion and delta loads.
• High proficiency in writing complex SQL stored procedures and dynamic SQL queries.
• Hands-on experience with version control (GitHub/DevOps) and CI/CD deployment pipelines.
• Familiarity with Power BI and data visualization concepts.
• Must be available to work hybrid (3 days onsite per week) in Jackson, MI.