Data Engineer

Giant Eagle, Inc.; Cranberry Township (Butler County); On-site; USD 74,000 - 86,000; Full time

Job summary

Giant Eagle is seeking a Data Engineer to join the Enterprise Data Platform team to help build data-centric applications with analytics, data science, and business partners. The role focuses on data access, integration, modeling, visualization, mining, design and implementation.

You'll work with Databricks, Airflow, PySpark, SQL, and Python across cloud environments, leveraging medallion architecture and modern data techniques to deliver scalable data solutions.

Qualifications

• Bachelor's degree in Computer Science required.
• Experience with data integration and pipelines for large-scale data.
• Proficiency in Python, SQL and data modeling.

Responsibilities

• Develop end-to-end data projects and translate business requirements into technical data-flow architectures.
• Build and automate data pipelines to clean, transform, and aggregate data for analysis.
• Apply analytic methods to discover information from multiple data sources to implement analytics solutions.
• Design databases and dataflows from marketing platforms into a cloud data lake.
• Work with data visualization tools and data modeling.
• Provide SME support across multiple projects through all development phases.
• Develop, enhance, govern, and administer the data platform to collect, transform, enrich, unify, segment, and integrate data.
• Ensure adherence to data ethics and PI I handling.
• Collaborate with IT, Performance Marketing, and business leaders to deliver actionable insights.
• Participate in on-call rotation as needed.
• Agile experience is a plus.
• Retail industry experience is a plus.

Skills

Databricks Delta Lake

Airflow

PySpark

SQL

Python

Cloud platforms

Medallion Architecture

Data Modeling

ETL/ELT

RESTful APIs

Software Engineering

Education

Bachelor's degree in Computer Science

Tools

Databricks

Airflow

Spark

Hive

Job description

Job Summary

As a Data Engineer on the Enterprise Data Platform team, you will be working on a team that brings data-centric applications to life. In this role, you will be working with analytics, data science, and business partners to understand capability requirements and develop data solutions based on priorities. This is a developer role in the areas of data techniques including data access, integration, modeling, visualization, mining, design and implementation.

Job Summary

As a Data Engineer on the Enterprise Data Platform team, you will be working on a team that brings data-centric applications to life. In this role, you will be working with analytics, data science, and business partners to understand capability requirements and develop data solutions based on priorities. This is a developer role in the areas of data techniques including data access, integration, modeling, visualization, mining, design and implementation.

Job Description

Technical Skills Required:

• Databricks – Delta Lake Warehouse concepts


• Airflow – Orchestration and data pipelining


• Pyspark + SQL + Python


• Cloud Platform Exposure - ( Any cloud platform but Azure would be preferred)


• Knowledge on Medallion Architecture


• Knowledge on Data Modelling


• 2+ years of relevant technical experience working with various data engineering methodologies such as data integration and data pipelines (ETL/ELT) to activate against data at scale.


• 1+ years of experience of data modeling for analytic projects activities that include design, curation, and management of large datasets


• Experience with Apache Airflow for orchestrating and scheduling complex data pipelines to ensure reliable and automated ETL workflows.


• 1+ years’ experience developing on big data technologies with Spark and Hive, preferably leveraging such as DataBricks, AWS, and Azure equivalent technology.


• Experience leveraging RESTful web services to collect and publish data.


• Experience in software engineering development and testing life cycles using but not limited to Python, R, Linux, Java, JavaScript, Lambda, and SQL programming


• Bachelor's degree in Computer Science

Job Responsibilities

• Develops and implements end-to-end complex data projects and technical solutions through translating business requirements into technical solutions and data-flow architectures.


• Build and automates data pipelines that clean, transform, and aggregate unorganized data into data sources that are ready for analysis.


• Use expertise to apply various analytic methods to discover and interpret information about data from multiple data sources to implement analytics solutions


• Use expertise in database design to implement, operate stable and scalable dataflows from multiple marketing platforms into a cloud data lake


• Experience with data visualization tools Tableau, PowerBI, and Looker with data modeling


• Design, implement and deploy data applications and mechanisms using big data technology


• Provides subject matter expertise for multiple projects concurrently through all phases of the development lifecycle.


• Develop, enhance, govern, and administer for data platform to: collect data, transform, enrich, unify, segment, and integrate data


• Strong adherence data ethics rules around PII data sets


• Work collaboratively with IT teams, Performance Marketing team, and business leaders to ensure actionable is provided key stakeholders’


• Off hours on-call support rotation as required


• Experience with agile or other rapid application development methods a plus


• Retail industry experience a plus

About Us

At Giant Eagle, we believe in nourishing life's moments, big and small, because they matter. We strive to lead the way in quality, service, and everyday value. Most importantly, the compassion, care, and respect our Team Members show to each other and in our communities is what truly sets us apart. Here, you'll find a place to win, grow, and be better together. If you want to make a real impact, belong to a supportive community, and build a meaningful career, we invite you to grow your future with us — because you matter.

The hiring range for this position is $73500.00- $85750.00 per hour/year. This range represents the anticipated base pay for this role. Actual compensation will be determined based on factors such as experience, skills, education, and location. Eligible employees may be offered health, vision, and dental insurance, personal/sick paid time, 401(k) retirement savings plan, bonus potential, paid bereavement, vacation and paid holidays.