Senior Data Engineer

Sobeys; Mississauga; Hybrid; CAD 110,000 - 150,000; Full time

Job summary

Sobeys is actively seeking a Senior Data Engineer to join the Data Integration Hub (DIH) within the Integration and COEs division in Mississauga, ON. The role focuses on enhancing DIH for major program deliverables and close collaboration with business SMEs, architects and technical leads.

The ideal candidate brings 5+ years of Spark/Azure Databricks experience, expertise in streaming, Unity Catalog, CI/CD, and a proven track record delivering scalable, cost-efficient data pipelines.

Qualifications

• 5+ years developing with Spark (Python/Databricks notebooks) in Azure Databricks.
• Strong knowledge of Delta Live Tables and structured streaming.
• Experience building scalable data ingestion frameworks.
• Experience enabling and using Unity Catalog.
• Proven ability to deliver resilient pipelines for operational systems.
• Collaborative with teams and able to align with sprint goals.
• Experience in performance and cost optimization of data solutions.
• CI/CD experience with Azure DevOps.
• Test-driven development experience.
• Azure Databricks certification is a plus.

Responsibilities

• Enhance and maintain the Data Integration Hub (DIH) to support major program deliverables.
• Work closely with business SMEs, architects and technical leads from various divisions within Sobeys.
• Translate data requirements to design and implementation.
• Provide mentorship to junior engineers and serve as trusted advisor to leadership.

Skills

Spark Python

Azure Databricks

Streaming

Delta Live Tables

CI/CD

Mentorship

Collaboration

Perf optimization

Unity Catalog

Azure DevOps

Test driven development

Job description

Sobeys is full of exciting opportunities, and we are always looking for bright new talent to join our team! We currently have a full time opportunity for a Senior Data Engineer role. This role can be based out of our offices located in Stellarton; NS, Mississauga, ON

Senior Data Engineer role will be part of the Data Integration Hub (DIH) within the 'Integration and COEs' department of Sobeys.

• Part of the enhancement and maintenance of DIH to support major program deliverables.
• Work closely with business SMEs, architects and technical leads from various divisions within Sobeys.
• Highly experienced in translating data requirements to design and implementation.
• Highly skilled in Azure Databricks, specifically streaming and event driven solutions.
• Highly skilled in performance and cost optimization of solutions.
• Solid expertise in CI/CD practices.
• Provides mentorship to junior engineers and serve as trusted advisor to leadership team.

#LI-Hybrid

What you have to offer:

• Significant experience (5+) developing with Spark (python/Vscode/Databricks Notebooks preferably) and specifically within Azure Databricks.
• Strong knowledge on DLT framework and structured streaming.
• Experienced in implementing scalable data ingestion frameworks.
• Experienced in enabling and using Unity catalog.
• Experienced in building a resilient solution for pipelines supporting operational systems.
• Experienced in engaging with the team towards a common sprint goal and be collaborative.
• Experienced in establishing Key Design Decisions and communicating with architects and core team for alignment.
• Actively engage in performance and cost optimization of the solution.
• Ability to identify redundant manual work and share opportunities to enable automation.
• Azure Dev Ops - CI/CD.
• Proven experience in test driven development.
• Azure and Databricks certification is a plus.