Senior Data Engineer: Python, Spark & Data Lake

Capgemini; Canada; On-site; CAD 80,000 - 120,000; Full time

Job summary

A leading technology consultancy in Canada is seeking a Senior Data Engineer (Python & Spark) to develop distributed data processing solutions. The ideal candidate will have over 5 years of experience in data engineering, excellent SQL and Python skills, and expertise in ETL orchestration. This role involves leading teams and creating data models for high-volume systems. The position supports a collaborative environment with a focus on innovation and excellence in data management.

Benefits

Healthcare including dental and vision

Financial well-being programs

Paid time off and paid holidays

Paid parental leave

Mentoring and learning programs

Qualifications

• 5+ years experience working in data engineering or similar.
• Proficiency in programming languages Python and SQL.
• Experience in ETL orchestration with tools like Airflow and Snowflake.

Responsibilities

• Build distributed data processing solutions for various business cases.
• Provide leadership and guidance to the development team.
• Design and implement large-scale data models and pipelines.

Skills

Python

SQL

Spark

Data Engineering

ETL orchestration

Communication skills

Education

University degree in Computer Related Sciences

Tools

Airflow

Snowflake

AWS

Job description

A leading technology consultancy in Canada is seeking a Senior Data Engineer (Python & Spark) to develop distributed data processing solutions. The ideal candidate will have over 5 years of experience in data engineering, excellent SQL and Python skills, and expertise in ETL orchestration. This role involves leading teams and creating data models for high-volume systems. The position supports a collaborative environment with a focus on innovation and excellence in data management.