Data Engineer - Kafka

Adusa; Quincy (MA); On-site; USD 101,360 - 152,040; Full time

Job summary

A leading grocery retailer is seeking a Data Engineer II to enhance their data architecture and support data initiatives. This role involves optimizing data flow, developing data pipelines, and ensuring data quality. Candidates should hold a Bachelor's Degree in Computer Science and have at least 3 years of relevant experience. Preferred qualifications include a Master's Degree and experience in retail environments. A flexible hybrid work arrangement is available with a competitive salary range of $101,360 - $152,040.

Qualifications

• 3+ years of experience in a relevant technology role is required.
• Strong understanding of data architecture and data flow.
• Ability to interpret requirement documents and create functional designs.

Responsibilities

• Solve application errors and problems, ensuring prompt resolution.
• Participate in developing streaming data applications and pipelines.
• Conduct data analysis on legacy systems and new sources.
• Create source to target data mappings for integration activities.
• Implement data governance policies for data quality and compliance.

Skills

Data analysis (SQL, Excel, Data Discovery)

Data pipeline development

Application problem-solving

Requirements gathering

Data transformation

Education

Bachelor's Degree in Computer Science or Technical field

Tools

Kafka

Data governance policies

Job description

Introduction

Ahold Delhaize USA, a division of global food retailer Ahold Delhaize, is part of the U.S. family of brands, which also includes five leading omnichannel grocery brands – Food Lion, Giant Food, The GIANT Company, Hannaford and Stop & Shop. Ahold Delhaize USA associates support the brands with a wide range of services, including Finance, Legal, Sustainability, Commercial, Digital and E-commerce, Technology and more.

Overview

The Data Engineer II contributes to the expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. They will contribute to our data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They engage through the entire lifecycle of a project from data mapping, data pipelines, data modeling, and finally data consumption. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. They will learn to optimize or even re-design our company's data architecture to support our next generation of products and data initiatives. They can take on smaller projects from start to finish, work on problems of moderate scope where analysis of situations or data requires a review of a variety of factors and trace issues to their source. They develop solutions to a variety of problems of moderate scope and complexity.

Our flexible/ hybrid work schedule includes 3 in-person days at one of our core locations and 2 remote days. Our core office locations include Salisbury, NC, Chicago, IL, and Quincy, MA.

Applicants must be currently authorized to work in the United States on a full-time basis.

Responsibilities

• Solves simple to moderate application errors, resolves application problems, following up promptly with all appropriate customers and IT personnel.
• Reviews and contributes to QA test plans and supports QA team during test execution.
• Participates in developing streaming data applications (Kafka), data transformation and data pipelines.
• Ensures change control and change management procedures are followed within the program/project as they relate to requirements.
• Able to interpret requirement documents, contributes to creating functional design documents as a part of data development life cycle.
• Documents all phases of work including gathering requirements, architectural diagrams, and other program technical specifications using current specified design standards for new or revised solutions.
• Relates information from various sources to draw logical conclusions.
• Conducts unit testing on data streams.
• Conducts data lineage and impact analysis as a part of the change management process.
• Conducts data analysis (SQL, Excel, Data Discovery, etc.) on legacy systems and new data sources.
• Creates source to target data mappings for data pipelines and integration activities.
• Assists in identifying the impact of proposed application development/enhancements projects.
• Performs data profiling and process analysis to understand key source systems and uses knowledge of application features and functions to assess scope and impact of business needs.
• Implement and maintain data governance policies and procedures to ensure data quality, security and compliance
• Ensure operational stability of a 24/7/365 grocery retail environment by providing technical support, system monitoring, and issue resolution which may be required during off-hours, weekends, and holidays as needed.

Requirements

• Bachelors Degree in Computer Science or Technical field; equivalent trainings/certifications/experience equivalency will be considered
• 3 or more years of equivalent experience in relevant job or field of technology

Preferred Qualifications

• Masters Degree in relevant field of study preferred, Additional trainings or certifications in relevant field of study preferred
• Experience in Agile teams and or Product/Platform based operating model.
• Experience in retail or grocery preferred.
• Experience with Kafka.

Salary Range

$101,360 - $152,040. Actual compensation offered to a candidate may vary based on their unique qualifications and experience, internal equity, and market conditions. Final compensation decisions will be made in accordance with company policies and applicable laws.