EA DT Engineer

abcsupply; Beloit (WI); On-site; USD 124,000 - 130,000; Full time

Job summary

ABC Supply, Beloit, WI, is seeking a data engineer to design, develop, and deliver large-scale data systems and pipelines. You will collaborate with stakeholders to build reliable, scalable datasets and support enterprise DW workloads with nightly extracts.

The role requires a master's or a bachelor with extensive experience in ETL, data warehouse modeling (Kimball), Python, PySpark, and cloud data platforms (Azure).

Qualifications

• Master's degree or equivalent with 2 years related experience; or Bachelor's with 5 years experience.
• Experience with ETL, data warehousing, and database management.
• Cloud-native modern data engineering projects and scalable pipelines.
• Knowledge of Kimball dimensional modeling.

Responsibilities

• Design, develop, and deliver large-scale data systems and pipelines.
• Extract, transform, load data into Azure data lake using ADF, Databricks, PySpark, SQL.
• Collaborate with BI team and stakeholders to deliver enterprise datasets.
• Plan and review database changes for DW work and improve data reliability.

Skills

Data pipelines

ETL processes

Python

PySpark

Spark SQL

Kimball modeling

Cloud data engineering

Education

Master's degree in Computer Science / IT / IS or related field

Bachelor's degree in Computer Science / IT / IS with 5 years experience

Tools

Databricks

Snowflake

Dremio

Azure Data Factory (ADF)

Job description

ABC Supply is North America's largest wholesale distributor of exterior and interior building products. ABC Supply is proud to be an employee-first company. In fact, we have won the Gallup Exceptional Workplace Award every year since its inception in 2007, and Glassdoor has named us one of the best places to work in the country. Be part of a company that recognizes your talents, rewards your efforts, and helps you reach your full potential. At ABC Supply, we have YOUR future covered.

This position is based in our Beloit, Wisconsin office and requires working onsite five days per week.

Job Description Summary:

Design, develop, and deliver large-scale data systems, data processing, and data transformation Pipelines. Collaborate with stakeholders to understand business needs and work closely with business to deliver enterprise grade datasets that are reliable, flexible, scalable, and provide low cost of ownership. Develop optimized and scalable batch integration solutions for ABC Supply, including traditional DW workloads and nightly large extracts that are scheduled. Extract data from various sources, transform it into a usable format, and load it into Azure data lake using ADF pipelines, Databricks, Pyspark and SQL. Design and build data models - star schema, snowflake. Understand common analytical data models like Kimball. Build physical data models that align with best practice and requirements. Plan, review, and perform the implementation of database changes for integrations/DW work. Work with BI team, PO to build required tables and transform data to load into Snowflake/Dremio. Perform data management tasks. Recommend ways to improve data reliability, efficiency, and quality.

Qualifications :

Master's degree in Computer Science, IT/IS, or related field of study and two (2) years of work experience in the job offered or related occupation in which the required experience was gained. In lieu of a Master's degree in Computer Science, IT/IS, or related field of study and two (2) years of work experience in the job offered or related occupation in which the required experience was gained, employer will accept a Bachelor's degree in Computer Science, IT/IS, or related field of study and five (5) years of experience in the job offered or related occupation in which the required experience was gained. Must also have demonstrated experience in the following: Enterprise integration patterns (EIP), data warehouse modeling, ETL processes, and database management; Development and data warehouse requirements gathering, analysis and design; Cloud native Modern Data Engineering projects; Designing, building, and deploying scalable data pipelines; Python, Pyspark and Spark SQL; and Analytical data models such as Kimball.

Salary offered for the position is: 123,600.00 - $130,000.00/year.

Primary Work Location: 1 ABC Parkway, Beloit, WI 53511.

Additional Locations: N/A

Work Shift: Not Specified

Benefits may include:

• Health, dental, and vision coverage - eligible after 60 days, low out of pocket
• 401(k) with generous company match - eligible after 60 days, immediately vested
• Employer paid employee assistance program
• Employer paid short term and long term disability
• Employer paid life insurance
• Flex spending
• Paid vacation
• Paid sick days
• Paid holidays

Equal Opportunity Employer / Drug Free Workplace

ABC Supply values diversity and we actively encourage women, minorities, and veterans to apply.

EOE.

#INDABCDNP