EA DT Engineer

ABC Supply Co. Inc.; Beloit (WI); On-site; USD 124,000 - 130,000; Full time

Benefits offered by this job

Health, dental, and vision coverage

401(k) with generous company match

Employer paid employee assistance

Employer paid disability insurance

Employer paid life insurance

Flex spending

Paid vacation

Paid sick days

Paid holidays

Job summary

ABC Supply Co. Inc. is seeking a Data Engineer to design, develop, and deploy large-scale data systems and pipelines.

You will extract, transform, and load data into Azure-based data lake environments using ADF, Databricks, PySpark, and SQL, while collaborating with stakeholders to deliver enterprise-grade datasets. The role emphasizes data modeling (star/snowflake), Kimball-based approaches, and building scalable, reliable data pipelines for the organization’s BI needs.

Qualifications

• Master's or Bachelor's degree as described with required experience.
• Experience with enterprise integration patterns (EIP) and data warehouse modeling.
• ETL development and data warehouse requirements gathering, analysis and design.
• Cloud-native modern data engineering projects; scalable data pipelines.
• Python, PySpark, and Spark SQL; analytical data models such as Kimball.

Responsibilities

• Design, develop, and deliver large-scale data systems, data processing, and pipelines.
• Collaborate with stakeholders to understand business needs and deliver enterprise-grade datasets.
• Extract data from sources, transform, and load into Azure data lake using ADF, Databricks, PySpark and SQL.
• Design and build data models (star schema, snowflake) and align with Kimball.
• Plan, review, and implement database changes for integrations/DW work.
• Work with BI team to load data into Snowflake/Dremio and ensure data quality.

Skills

Python

Pyspark

Spark SQL

ETL processes

Data modeling

DW modeling

Azure Data Lake

ADF pipelines

Databricks

SQL

Education

Master's degree in CS/IT/IS

Bachelor's degree in CS/IT/IS

Tools

Databricks

Azure Data Lake

ADF pipelines

SQL

Snowflake

Dremio

Job description

ABC Supply is North America's largest wholesale distributor of exterior and interior building products.

ABC Supply is proud to be an employee-first company. In fact, we have won the Gallup Exceptional Workplace Award every year since its inception in 2007, and Glassdoor has named us one of the best places to work in the country. Be part of a company that recognizes your talents, rewards your efforts, and helps you reach your full potential. At ABC Supply, we have YOUR future covered.

This position is based in our Beloit, Wisconsin office and requires working onsite five days per week.

Job Description Summary:

Design, develop, and deliver large-scale data systems, data processing, and data transformation Pipelines. Collaborate with stakeholders to understand business needs and work closely with business to deliver enterprise grade datasets that are reliable, flexible, scalable, and provide low cost of ownership. Develop optimized and scalable batch integration solutions for ABC Supply, including traditional DW workloads and nightly large extracts that are scheduled. Extract data from various sources, transform it into a usable format, and load it into Azure data lake using ADF pipelines, Databricks, Pyspark and SQL. Design and build data models - star schema, snowflake. Understand common analytical data models like Kimball. Build physical data models that align with best practice and requirements. Plan, review, and perform the implementation of database changes for integrations/DW work. Work with BI team, PO to build required tables and transform data to load into Snowflake/Dremio. Perform data management tasks. Recommend ways to improve data reliability, efficiency, and quality.

Qualifications:

Master's degree in Computer Science, IT/IS, or related field of study and two (2) years of work experience in the job offered or related occupation in which the required experience was gained. In lieu of a Master's degree in Computer Science, IT/IS, or related field of study and two (2) years of work experience in the job offered or related occupation in which the required experience was gained, employer will accept a Bachelor's degree in Computer Science, IT/IS, or related field of study and five (5) years of experience in the job offered or related occupation in which the required experience was gained. Must also have demonstrated experience in the following: Enterprise integration patterns (EIP), data warehouse modeling, ETL processes, and database management; Development and data warehouse requirements gathering, analysis and design; Cloud native Modern Data Engineering projects; Designing, building, and deploying scalable data pipelines; Python, Pyspark and Spark SQL; and Analytical data models such as Kimball.

Salary offered for the position is: 123,600.00 - $130,000.00/year.

Primary Work Location:

1 ABC Parkway, Beloit, WI 53511.

Additional Locations:

N/A

Work Shift:

Not Specified

Benefits may include:

• Health, dental, and vision coverage - eligible after 60 days, low out of pocket
• 401(k) with generous company match - eligible after 60 days, immediately vested
• Employer paid employee assistance program
• Employer paid short term and long term disability
• Employer paid life insurance
• Flex spending
• Paid vacation
• Paid sick days
• Paid holidays

Equal Opportunity Employer / Drug Free Workplace

ABC Supply values diversity and we actively encourage women, minorities, and veterans to apply.

#INDABCDNP