Data Engineer 1

Pattison Food Group; City of Langley; On-site; CAD 85,000 - 106,000; Full time

Benefits offered by this job

Free parking

Company pension plan

Exclusive team member offers

Career development opportunities

Job summary

Pattison Food Group Ltd. is hiring a Data Engineer to join our Langley IT team. You will design and build high-performance data pipelines and enable ML models with scalable data processing in a Spark/Databricks environment.

You will work with cloud-native data lake solutions, perform data wrangling and feature engineering, and collaborate with ML engineers to productionize models. Mentoring junior engineers is also part of the role.

Qualifications

• Bachelor’s degree in a STEM discipline at minimum; Master’s preferred.
• 2+ years of experience in creating and managing large-scale distributed data pipelines.
• Expertise in Python and Spark; knowledge of Java/Scala/C++ is a plus.
• Expertise in SQL with strong data modeling skills.
• Experience designing high-performance data processing systems with data validation, monitoring, and logging.

Responsibilities

• Designing and constructing high-performance, scalable data pipelines to operationalize advanced solutions.
• Creating innovative data processing solutions for computational challenges and business issues.
• Writing production Python/Scala scripts in a Spark/Databricks environment to support data pipelines feeding ML models.
• Leveraging cloud environments and best practices to build data lake solutions.
• Performing data wrangling, feature engineering, and dimension reduction across diverse data types.
• Collaborating with ML engineers, data scientists, and cloud architects to productionize models.
• Coaching and mentoring junior data engineers.
• Discovering novel datasets and data sources for modeling and reporting.
• Championing data-stores design and scalable data lake platforms, with QA best practices.

Skills

Python

Spark

SQL

Java/Scala/C++

Hadoop

Databricks

CI/CD

Data pipelines

Education

Bachelor’s degree in STEM

Master’s degree preferred

Tools

Spark/Databricks

Hadoop

CI/CD tools

Job description

Come join Pattison Food Group Ltd., a Jim Pattison business, and Canada’s largest Western-based provider of food and health products.

Pattison Food Group Ltd. consists of Save-On-Foods and other well-known grocery banners. With nearly 300 retail locations, we proudly employ more than 30,000 team members.

We have an exciting opportunity for a full-time Data Engineer to join our IT team in Langley, BC.

You will be responsible for:

• Designing and constructing high-performance, scalable data pipelines to operationalize our state-of-the-art solutions ranging from quantum computing pipelines to deep learning based recommender systems
• Creating innovative solutions to tackle computationally intensive challenges and business issues
• Writing production Python/Scala scripts in a Spark/Databricks environment to support the data pipelines that feed Machine Learning models
• Leveraging cloud environments and following best practices while building solutions in the data lake as it evolves to meet the needs of the business
• Performing data wrangling, feature engineering, and dimension reduction with data of all shapes and sizes, from parquet files to images
• Partnering with Machine Learning Engineers, Data Scientists, and Cloud Architects to deliver models into production
• Coaching, mentoring, and providing feedback to team members and junior data engineers
• Discovering novel datasets and data sources and making them available for modeling and reporting
• Using your expertise in big data technologies to champion innovation, design, and implement data-stores and analytic models, oversee large-scale data lake platforms, and design and implement efficient data pipelines from source systems to data-stores
• Defining and implementing Quality Assurance best practices that support the implementation of data transformations and the availability of high-quality data.

You have:

• A Bachelor’s degree in a STEM discipline at minimum, a Master’s is preferred.
• A minimum 2 years of experience in creating and managing large-scale, distributed data
• Expertise in Python and Spark. Experience in other programming languages such as Java, Scala, or C++ is a plus
• Expertise in SQL
• Experience designing and deploying high-performance data processing systems with reliable data validation, monitoring, and logging practices
• Rigor in high code quality, automated testing, and other engineering best practices
• Experience with big data technologies such as Hadoop, Spark and Databricks
• Familiarity with software development best practices, including version control, CI/CD and CAB processes
• Expert knowledge of databases and modern data workloads

You are:

• A strong communicator
• Detail-oriented and organized
• A leader with an ownership mindset
• Passionate about machine learning
• Able to work independently and as part of a team

What We Offer

In addition to a highly competitive salary, we offer a great range of benefits, a company pension plan, free parking, exclusive team member offers, and opportunities for development and career progression.

If you’re looking to join a team that puts people first, you’re in the right place.

Compensation Details:

$85,062.00 - $106,328.00

The compensation offered for this position will take into consideration location, education, skills, experience and other factors.