Senior Data Engineer - Databricks & Azure for Banking

Soar Consultants; Toronto; On-site; CAD 80,000 - 100,000; Full time

Job summary

A leading data consulting firm is seeking a Data Engineer for a client in Toronto. The role requires experience with Azure, Databricks, and strong skills in data analysis and integration methodologies, particularly within the Banking/Finance sectors. The ideal candidate will have a Bachelor's degree in Computer Science and over 5 years of IT experience. Responsibilities include designing data pipelines, ensuring data quality, and developing ETL processes. Competitive compensation is offered.

Qualifications

• Minimum 5 years experience in Information Technology, participating in complex projects.
• Strong programming skills in Pyspark and Apache Spark Architecture.
• Experience building data pipelines for streaming data using Databricks Structured Streaming.

Responsibilities

• Analyze and understand business requirements related to data.
• Design data integration and ETL processes.
• Develop automated unit-testing to ensure data quality.

Skills

Data analysis

Strong SQL knowledge

Pyspark programming

Data warehousing

Data integration methodologies

Communication skills

Cloud services knowledge

Data quality assurance

Education

Bachelor's degree in Computer Science

Tools

Databricks

Azure Data Factory

Apache Spark

Delta Lake

ETL tools (SSIS, Informatica, Data Stage)

Job description

A leading data consulting firm is seeking a Data Engineer for a client in Toronto. The role requires experience with Azure, Databricks, and strong skills in data analysis and integration methodologies, particularly within the Banking/Finance sectors. The ideal candidate will have a Bachelor's degree in Computer Science and over 5 years of IT experience. Responsibilities include designing data pipelines, ensuring data quality, and developing ETL processes. Competitive compensation is offered.