Azure Data Engineer - Data Pipelines & Spark Expert

Inherent Technologies, Inc.; Jackson (MI); On-site; USD 90,000 - 130,000; Full time

Job summary

Inherent Technologies, Inc. in Michigan seeks a hands-on Data Engineer to design and implement end-to-end data solutions on Azure, including Synapse Analytics, Data Factory and Databricks. You will work with SQL pools, pipelines, and APIs to move and transform data.

The ideal candidate will mentor CI/CD deployment, write Python with PySpark, and create notebooks and Power BI visuals; experience with data governance and security via Key Vault is a plus.

Qualifications

• Hands-on expertise in Azure data services and pipelines.
• Strong SQL and data movement/transformations experience.
• Proficient with Python data libraries and PySpark.
• Experience deploying code across dev/QA/Prod with CI/CD.

Responsibilities

• Design and implement end-to-end data pipelines on Azure.
• Collaborate with data consumers to meet reporting needs.
• Support data governance, security, and performance optimization.

Skills

Azure

Python

PySpark

Power BI

GitHub

CI/CD

Tools

Azure Synapse Analytics

Azure Data Factory

Azure Databricks

Azure Storage

Azure Key Vault

SQL Pools CI/CD

Notebooks

Spark

Job description

Inherent Technologies, Inc. in Michigan seeks a hands-on Data Engineer to design and implement end-to-end data solutions on Azure, including Synapse Analytics, Data Factory and Databricks. You will work with SQL pools, pipelines, and APIs to move and transform data.

The ideal candidate will mentor CI/CD deployment, write Python with PySpark, and create notebooks and Power BI visuals; experience with data governance and security via Key Vault is a plus.