Databricks Data Engineer: Lakehouse, Delta & AWS

Citco GSGS; Toronto; On-site; CAD 85,000 - 105,000; Full time

Job summary

A global financial services provider in Toronto is seeking a Data Engineer to build and maintain data pipelines using the Databricks Lakehouse Platform. The ideal candidate will have a Bachelor's degree in Computer Science and over 4 years of data engineering experience, particularly with Python and AWS services. This role offers an opportunity to collaborate with diverse teams and contribute to innovative data solutions while enjoying several benefits supporting work-life balance.

Benefits

Range of benefits

Training and education support

Flexible working arrangements

Qualifications

• 4+ years of experience in data engineering.
• 1+ years of hands-on experience with Databricks platform.
• Understanding of ETL/ELT principles and patterns.

Responsibilities

• Develop and maintain data pipelines using Databricks Lakehouse and Delta Lake.
• Implement ETL/ELT workflows using Spark (Python) in Databricks environment.
• Work with AWS services (S3, Glue) for data lake storage and catalog management.
• Create and optimize Spark jobs for efficient data processing and cost management.

Skills

Strong programming skills in Python

Experience with Spark and distributed computing

Working knowledge of AWS services (S3, Glue, Lambda)

Experience with Delta Lake and Lakehouse architecture

Familiarity with data modelling and SQL

Experience with version control systems (Git)

Experience with CI/CD for data pipelines

Familiarity with Agile development methodologies

Experience with real-time data processing

Good communication and collaboration abilities

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Databricks

Spark

AWS

Job description

A global financial services provider in Toronto is seeking a Data Engineer to build and maintain data pipelines using the Databricks Lakehouse Platform. The ideal candidate will have a Bachelor's degree in Computer Science and over 4 years of data engineering experience, particularly with Python and AWS services. This role offers an opportunity to collaborate with diverse teams and contribute to innovative data solutions while enjoying several benefits supporting work-life balance.