Data Engineer: Azure Data Lake, Spark & Snowflake

ABC Supply Co. Inc.; Beloit (WI); On-site; USD 124,000 - 130,000; Full time

Benefits offered by this job

Health insurance

401(k) match

EAP (employee assistance) program

Disability insurance (short/long)

Life insurance

Flex spending (FSA)

Paid vacation

Paid sick days

Paid holidays

Job summary

ABC Supply Co. Inc. in Beloit, WI seeks a Data Engineer to design, develop, and deliver large-scale data systems and pipelines that are reliable, scalable, and cost-effective.

You will extract data from various sources, transform it, and load it into Azure Data Lake using ADF, Databricks, PySpark and SQL. Build star/snowflake models and collaborate with the BI team to load data into Snowflake/Dremio. The role requires advanced education with relevant experience and offers a salary of

Qualifications

• Advanced degree with relevant work experience or equivalent in data engineering.
• Experience in data warehousing, ETL, and integration patterns.
• Ability to design scalable data pipelines and analytical models.

Responsibilities

• Design, develop, and deliver large-scale data systems and pipelines.
• Extract, transform, and load data into Azure data lake using ADF, Databricks, PySpark, and SQL.
• Build star/snowflake data models and collaborate with BI teams to load data into Snowflake/Dremio.
• Improve data reliability, efficiency, and quality across enterprise datasets.

Skills

Python

Pyspark

Spark SQL

ETL processes

Data modeling

Kimball

Cloud data engineering

Stakeholder collaboration

Education

Master’s degree in Computer Science / IT/IS

Bachelor’s degree in Computer Science / IT/IS

Tools

Azure Data Lake

ADF pipelines

Databricks

Snowflake

Dremio

Job description

ABC Supply Co. Inc. in Beloit, WI seeks a Data Engineer to design, develop, and deliver large-scale data systems and pipelines that are reliable, scalable, and cost-effective.

You will extract data from various sources, transform it, and load it into Azure Data Lake using ADF, Databricks, PySpark and SQL. Build star/snowflake models and collaborate with the BI team to load data into Snowflake/Dremio. The role requires advanced education with relevant experience and offers a salary of