Principal Data Engineer

The J.M. Smucker Company; Greater London; Hybrid; USD 80,000 - 110,000; Full time

Job summary

Join a forward-thinking company as a Principal Data Engineer & Data Modeler, where you'll lead a team in delivering innovative data solutions. This role involves modernizing data pipelines, ensuring best practices in data processing, and collaborating on large cross-functional projects. With a focus on utilizing cloud technologies and advanced data engineering tools, you'll play a critical role in shaping the future of data analytics. If you're passionate about data and eager to drive impactful change, this is the perfect opportunity for you.

Benefits

Flexible Work Arrangements

Health Insurance

Retirement Plan

Professional Development Opportunities

Employee Assistance Programs

Qualifications

• 15+ years of experience in data engineering and analytics.
• Deep understanding of analytical concepts and data modeling.
• Experience with cloud data tools and modern IT concepts.

Responsibilities

• Lead data engineering team to modernize data pipelines.
• Implement and integrate cloud-based solutions.
• Ensure high-quality data processing best practices.

Skills

Data Engineering

Data Modeling

AWS

SQL

Python

Apache Spark

ETL/ELT Best Practices

Data Analytics

Education

Bachelor's Degree in Computer Science or related field

Tools

Databricks

Fivetran

Informatica IDMC

Job description

Your Opportunity as the Principal Data Engineer & Data Modeler

Responsible for delivering data ingestion and storage for use in full company analytics. Establishes the adoption of ETL/ELT best practices among a team of Data Engineers for consistency and quality control of critical data sets used in reporting and Data Science executions. Influence for upcoming technology solutions. Leads the team to modernize our data pipelines and maintain automations to create proactive pipeline health tools. Solves unique and complex problems impacting a domain, with a keen understanding of touchpoints with adjacent areas and relationships to business process.

Location: Orrville, OH (Close proximity to Cleveland/Akron)

Work Arrangements: Hybrid ~30% on-site expectation

In this role you will:

Process Excellence (30%)

• Guides the team on knowing when to invest in tech or focus on delivery (appropriate ROI vs. strategic horizons).

• Involved with introducing/operationalizing new data engineering tools and technologies.

• Reviews existing and upcoming data pipelines architectures to ensure automation is utilized where possible.

• Advise team of Developers, Data Engineers and Data Scientists to maintain high quality data processing best practices for their specific use case development.

• Creates an environment of Proactive Pipeline Health by applying monitoring and alerting tools.

• Create ridged process systems that maintains quality with automated tooling for testing, monitoring, access reviews and auditing.

• Enforce best practices inside the orchestration of automated procedures in a CI/CD pipeline.

• Advances the engineering discipline through leadership roles in the Data Engineering community.

• Owns creation and maintenance of data engineering learning paths.

Solution Delivery (60%)

• Provide deep technical expertise to the delivery of large, cross-functional projects that involve implementing and integrating cloud-based and on-premise solutions. Balances legacy solutions that have served a strategic role while modernizing techniques and migrating to new tooling.

• Create data models joining cross-company data sets.

• Move from legacy night batch processes to inter-day batching and eventually streaming data.

• Coaches other team members, estimating effort and articulating needs, and executing against solution architecture decisions. Requires thorough understanding of delivery principles and methodologies. Relies on professional discretion to influence outcomes and achieve goals.

• Develops cost saving model. Challenges new and existing cross-functional architectural strategies to optimize synergies for cost savings opportunities maintaining FinOps recommendations.

• Works with cross-functional teams to align and influence overall documentation model for data engineering and analytics function.

• Applies a holistic view of data platforms integrate and understands interrelationships with adjacent disciplines/functions. Applies advanced techniques and modern IT concepts to solve complex development problems.

• Leverages knowledge of how to build data pipelines for Data Scientist. Have a holistic understanding of Analytics, Data Science and AI needs for Data Engineering.

• Determines product requirements and develops high-level development specifications with a focus on feasibility, functionality, security, and scalability.

• Advises team through the process of solution delivery involving complex and/or newer technologies, often requiring research and experimentation to complete. Partners with external vendors to ensure technology solutions are aligned with internal project goals. Influences external products/technologies.

• Works with teams to develop solutions that are in accordance with accepted testing frameworks, identifying opportunities for automation.

• May lead cutover planning and mock cutover exercises. Guides teams to consider how the feature will be deployed with minimal disruption to production and how the feature will be monitored.

Solution Support (10%)

• Provides a sense of calm in pressure filled situations, bonding co-workers together to handle future support problems with ease.

• Teaches teams to use operational data to improve stability and performance of their domains.

• Demonstrates proficiency in systematic debugging to diagnose all issues within a set of related domains.

• Drives cross-domain maintenance efforts.

• Champions an appropriate release/version strategy.

• Serves as an escalation point and consults teams on complex support matters.

• Holds vendor accountable to SLAs. Seeks resolution to contract violations.

The Right Place for You

We are bold, kind, strive to do the right thing, we play to win, and we believe in a strong community that thrives together. Our culture is rooted in our Basic Beliefs, and we believe in supporting every employee by meeting their physical, emotional, and financial needs.

What we are looking for:

Minimum Requirements:

• 15+ years of relevant data engineering work experience

• Specialized depth in particular area(s) of Data, Analytics or Data Science technical discipline

• Experience with cloud data tools like AWS, Databricks, Fivetran, Informatica IDMC, Atlan or comparable tools

• Experience executing Data Modeling

• Ownership of decisions within software development lifecycle

• Awareness and application of various project management and software development methodologies

• Deep understanding of analytical concepts (dimensions, facts, normalization, joins, querying & grouping, syntax, etc.)

• Understands modern data related IT concepts (DevOps, DataOps, MLOps, AI, Extensibility, Secure By Design, etc)

• Leads by helping others succeed through positive motivation, while supporting existing leadership and team norms

• Puts people first, Makes things better mindset

• Demonstrated ability to convey concepts to technical and non-technical audiences

• Deep knowledge of technical architecture and concept

• Relevant programming language PySpark, SQL, Python skills, Apache Spark and/or technical delivery certification(s)

Additional skills and experience that we think would make someone successful in this role (not required):

• Prior experience in CPG and/or Enterprise Information Services

Learn more about working at Smucker:

• Helping our Employees Thrive

• Delivering on Our Purpose

• Our Continued Commitment to Ensuring a Workplace for All

Follow us on LinkedIn

#LI-CM1

#LI-Hybrid