Data Engineer

Save-On-Foods; City of Langley; In loco; CAD 85.000 - 106.000; Tempo pieno

Vantaggi offerti da questo lavoro

Benefits

Company pension

Free parking

Exclusive team offers

Descrizione del lavoro

Pattison Food Group Ltd. is seeking a Data Engineer to join the Langley IT team in Langley, BC. You will work on large datasets, building scalable data solutions and modern data pipelines using Databricks, Spark, Python/PySpark, and SQL.

Reporting to the Team Lead, Data & Analytics, you will contribute to robust data models, governance, and CI/CD practices while optimizing performance and cost efficiency.

Competenze

• Bachelor’s degree in a STEM discipline; Master’s preferred.
• Strong SQL and Python/PySpark skills with large datasets.
• Experience with Databricks, Spark, Delta Lake or similar platforms.
• Experience with data pipeline orchestration tools like Azure Data Factory or Databricks Jobs.

Mansioni

• Build and maintain scalable data solutions using Medallion Architecture in Delta Lake/lakehouse platforms.
• Design and develop high-performance, scalable data pipelines using Databricks, Spark, Python/PySpark and SQL.
• Develop dimensional and analytical data models with fact/dimension tables and slowly changing dimensions.
• Write production Python/Scala scripts in Spark/Databricks to support data pipelines feeding ML models.

Conoscenze

SQL

Python/PySpark

Formazione

Bachelor’s degree in STEM

Master’s degree preferred

Strumenti

Databricks

Spark

Delta Lake

Azure Data Factory

Descrizione del lavoro

Data Engineer# Pattison Food Group## Data EngineerApply: Langley Office - Langley BC: Full time: Posted 2 Days Ago: R-00041820Come join Pattison Food Group Ltd., a Jim Pattison business, and Canada’s largest Western-based provider of food and health products. Pattison Food Group Ltd. consists of Save-On-Foods and other well-known grocery banners. With nearly 300 retail locations, we proudly employ more than 30,000 team members. We have an exciting opportunity for a full-time **Data Engineer** to join our IT team in **Langley, BC.** Reporting to the Team Lead, Data & Analytics, you will be responsible for working with one of the largest, most comprehensive datasets in Canada while delivering and pioneering solutions that will disrupt the retail industry using the latest tools and technologies.**You will be responsible for:*** Building and maintaining scalable, well-structured data solutions using Medallion Architecture in modern delta lake/lakehouse platforms* Designing and developing, high-performance, scalable data pipelines using Databricks, Spark, Python/PySpark and SQL* Developing dimensional and analytical data models, including fact and dimension tables, slowly changing dimensions, incremental processing, change data capture, and reusable curated datasets.* Writing production Python/Scala scripts in a Spark/Databricks environment to support the data pipelines that feed Machine Learning models* Orchestrating data ingestion, transformation, scheduling, monitoring, and recovery processes using ADF / Databricks Automation Bundles* Applying data-quality, testing, documentation, security, and governance standards throughout the development lifecycle.* Optimizing data pipelines and models to improve performance, scalability, reliability, and cost efficiency. Identifying opportunities to simplify processing and improve overall solution design.* Using version control, code reviews, CI/CD, and established release-management practices.* Working with business and technical partners to understand requirements and translate them into practical data solutions.* Troubleshooting production issues and contributing to ongoing platform and process improvements.**You have:*** A Bachelor’s degree in a STEM discipline at minimum, a Master’s is preferred.* A minimum 2 years of experience building and supporting production data pipelines in a cloud-based environment* Strong SQL and Python/PySpark skills, with experience working with large datasets.* Experience with Databricks, Spark, Delta Lake, or a comparable modern data platform.* Experience with data pipeline orchestration using Azure Data Factory, Databricks Jobs, or similar tools.* Knowledge of modern data architecture, ETL/ELT, data modelling, incremental processing, data quality, and production support.* Familiarity with Git-based version control, automated testing, and CI/CD practices.* The ability to communicate clearly, document solutions, and work effectively with technical and non-technical partners.**You are:*** A practical problem solver with an ownership mindset.* Detail-oriented and committed to delivering reliable, supportable solutions.* A collaborative communicator who works well across teams.* Curious and adaptable, with an interest in modern data technologies and continuous improvement.**What we offer**In addition to **a highly competitive salary**, we offer a great range of **benefits**, a **company pension plan,** **free parking, exclusive team member offers, and opportunities for development and career progression.**If you’re looking to join a team that puts people first, you’re in the right place. Apply online today! IND6 **Compensation Details:**$85,062.00 - $106,328.00The compensation offered for this position will take into consideration location, education, skills, experience and other factors.