IT Data Engineer

ABC Supply Co. Inc.; Beloit (WI); On-site; USD 124,000 - 130,000; Full time

Benefits offered by this job

Health insurance

401(k) match

EAP (employee assistance) program

Disability insurance (short/long)

Life insurance

Flex spending (FSA)

Paid vacation

Paid sick days

Paid holidays

Job summary

ABC Supply Co. Inc. in Beloit, WI seeks a Data Engineer to design, develop, and deliver large-scale data systems and pipelines that are reliable, scalable, and cost-effective.

You will extract data from various sources, transform it, and load it into Azure Data Lake using ADF, Databricks, PySpark and SQL. Build star/snowflake models and collaborate with the BI team to load data into Snowflake/Dremio. The role requires advanced education with relevant experience and offers a salary of

Qualifications

• Advanced degree with relevant work experience or equivalent in data engineering.
• Experience in data warehousing, ETL, and integration patterns.
• Ability to design scalable data pipelines and analytical models.

Responsibilities

• Design, develop, and deliver large-scale data systems and pipelines.
• Extract, transform, and load data into Azure data lake using ADF, Databricks, PySpark, and SQL.
• Build star/snowflake data models and collaborate with BI teams to load data into Snowflake/Dremio.
• Improve data reliability, efficiency, and quality across enterprise datasets.

Skills

Python

Pyspark

Spark SQL

ETL processes

Data modeling

Kimball

Cloud data engineering

Stakeholder collaboration

Education

Master’s degree in Computer Science / IT/IS

Bachelor’s degree in Computer Science / IT/IS

Tools

Azure Data Lake

ADF pipelines

Databricks

Snowflake

Dremio

Job description

ABC Supply is North America’s largest wholesale distributor of exterior and interior building products.

ABC Supply is proud to be an employee-first company. In fact, we have won the Gallup Exceptional Workplace Award every year since its inception in 2007, and Glassdoor has named us one of the best places to work in the country. Be part of a company that recognizes your talents, rewards your efforts, and helps you reach your full potential. At ABC Supply, we have YOUR future covered.

Job Description Summary

Design, develop, and deliver large-scale data systems, data processing, and data transformation Pipelines. Collaborate with stakeholders to understand business needs and work closely with business to deliver enterprise grade datasets that are reliable, flexible, scalable, and provide low cost of ownership. Develop optimized and scalable batch integration solutions for ABC Supply, including traditional DW workloads and nightly large extracts that are scheduled. Extract data from various sources, transform it into a usable format, and load it into Azure data lake using ADF pipelines, Databricks, Pyspark and SQL. Design and build data models – star schema, snowflake. Understand common analytical data models like Kimball. Build physical data models that align with best practice and requirements. Plan, review, and perform the implementation of database changes for integrations/DW work. Work with BI team, PO to build required tables and transform data to load into Snowflake/Dremio. Perform data management tasks. Recommend ways to improve data reliability, efficiency, and quality.

Qualifications

Master’s degree in Computer Science, IT/IS, or related field of study and two (2) years of work experience in the job offered or related occupation in which the required experience was gained. In lieu of a Master’s degree in Computer Science, IT/IS, or related field of study and two (2) years of work experience in the job offered or related occupation in which the required experience was gained, employer will accept a Bachelor’s degree in Computer Science, IT/IS, or related field of study and five (5) years of experience in the job offered or related occupation in which the required experience was gained. Must also have demonstrated experience in the following: Enterprise integration patterns (EIP), data warehouse modeling, ETL processes, and database management; Development and data warehouse requirements gathering, analysis and design; Cloud native Modern Data Engineering projects; Designing, building, and deploying scalable data pipelines; Python, Pyspark and Spark SQL; and Analytical data models such as Kimball.

Salary offered for the position is: 123,600.00 - $130,000.00/year.

Primary Work Location

1 ABC Parkway, Beloit, WI 53511.

Additional Locations

N/A

Work Shift

Not Specified

EOE.

Benefits May Include

• Health, dental, and vision coverage - eligible after 60 days, low out of pocket
• 401(k) with generous company match - eligible after 60 days, immediately vested
• Employer paid employee assistance program
• Employer paid short term and long term disability
• Employer paid life insurance
• Flex spending
• Paid vacation
• Paid sick days
• Paid holidays

Equal Opportunity Employer / Drug Free Workplace

ABC Supply values diversity and we actively encourage women, minorities, and veterans to apply.

#INDABCDNP