Senior Enterprise Data Engineer | Azure & Databricks

abcsupply; Beloit (WI); On-site; USD 124,000 - 130,000; Full time

Job summary

ABC Supply, Beloit, WI, is seeking a data engineer to design, develop, and deliver large-scale data systems and pipelines. You will collaborate with stakeholders to build reliable, scalable datasets and support enterprise DW workloads with nightly extracts.

The role requires a master's or a bachelor with extensive experience in ETL, data warehouse modeling (Kimball), Python, PySpark, and cloud data platforms (Azure).

Qualifications

• Master's degree or equivalent with 2 years related experience; or Bachelor's with 5 years experience.
• Experience with ETL, data warehousing, and database management.
• Cloud-native modern data engineering projects and scalable pipelines.
• Knowledge of Kimball dimensional modeling.

Responsibilities

• Design, develop, and deliver large-scale data systems and pipelines.
• Extract, transform, load data into Azure data lake using ADF, Databricks, PySpark, SQL.
• Collaborate with BI team and stakeholders to deliver enterprise datasets.
• Plan and review database changes for DW work and improve data reliability.

Skills

Data pipelines

ETL processes

Python

PySpark

Spark SQL

Kimball modeling

Cloud data engineering

Education

Master's degree in Computer Science / IT / IS or related field

Bachelor's degree in Computer Science / IT / IS with 5 years experience

Tools

Databricks

Snowflake

Dremio

Azure Data Factory (ADF)

Job description

ABC Supply, Beloit, WI, is seeking a data engineer to design, develop, and deliver large-scale data systems and pipelines. You will collaborate with stakeholders to build reliable, scalable datasets and support enterprise DW workloads with nightly extracts.

The role requires a master's or a bachelor with extensive experience in ETL, data warehouse modeling (Kimball), Python, PySpark, and cloud data platforms (Azure).