Senior Data Engineer - Azure Data Lake, Databricks & DW

ABC Supply Co. Inc.; Beloit (WI); Presencial; USD 124 000 - 130 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health, dental, and vision coverage

401(k) with generous company match

Employer paid employee assistance

Employer paid disability insurance

Employer paid life insurance

Flex spending

Paid vacation

Paid sick days

Paid holidays

Resumo da oferta

ABC Supply Co. Inc. is seeking a Data Engineer to design, develop, and deploy large-scale data systems and pipelines.

You will extract, transform, and load data into Azure-based data lake environments using ADF, Databricks, PySpark, and SQL, while collaborating with stakeholders to deliver enterprise-grade datasets. The role emphasizes data modeling (star/snowflake), Kimball-based approaches, and building scalable, reliable data pipelines for the organization’s BI needs.

Qualificações

• Master's or Bachelor's degree as described with required experience.
• Experience with enterprise integration patterns (EIP) and data warehouse modeling.
• ETL development and data warehouse requirements gathering, analysis and design.
• Cloud-native modern data engineering projects; scalable data pipelines.
• Python, PySpark, and Spark SQL; analytical data models such as Kimball.

Responsabilidades

• Design, develop, and deliver large-scale data systems, data processing, and pipelines.
• Collaborate with stakeholders to understand business needs and deliver enterprise-grade datasets.
• Extract data from sources, transform, and load into Azure data lake using ADF, Databricks, PySpark and SQL.
• Design and build data models (star schema, snowflake) and align with Kimball.
• Plan, review, and implement database changes for integrations/DW work.
• Work with BI team to load data into Snowflake/Dremio and ensure data quality.

Conhecimentos

Python

Pyspark

Spark SQL

ETL processes

Data modeling

DW modeling

Azure Data Lake

ADF pipelines

Databricks

SQL

Formação académica

Master's degree in CS/IT/IS

Bachelor's degree in CS/IT/IS

Ferramentas

Databricks

Azure Data Lake

ADF pipelines

SQL

Snowflake

Dremio

Descrição da oferta de emprego

ABC Supply Co. Inc. is seeking a Data Engineer to design, develop, and deploy large-scale data systems and pipelines.

You will extract, transform, and load data into Azure-based data lake environments using ADF, Databricks, PySpark, and SQL, while collaborating with stakeholders to deliver enterprise-grade datasets. The role emphasizes data modeling (star/snowflake), Kimball-based approaches, and building scalable, reliable data pipelines for the organization’s BI needs.