Senior Cloud Data Engineer: PySpark, Snowflake & ETL

ALLTECH CONSULTING SVC INC; Mississauga; On-site; CAD 80,000 - 120,000; Full time

Job summary

A leading consulting service firm is seeking a Cloud Data Engineer to optimize data pipelines and design data solutions in a Databricks environment. The ideal candidate will have strong programming skills in Python and SQL, with experience in data warehousing and ETL processes. This role requires collaboration with business users and analysts, making expertise in data integration and cloud services essential.

Qualifications

• 5+ years Python coding experience.
• 5+ years SQL Server based development.
• Experience with ETL pipelines using Databricks Pyspark.

Responsibilities

• Build and optimize data pipelines for data ingestion and transformation.
• Design, develop, and deploy Spark programs in the Databricks environment.
• Implement data management best practices in the Databricks setup.

Skills

Python

SQL

Pyspark

Data Warehouse Concepts

Education

Cloud certification(s)

Tools

Databricks

Snowflake

ETL

Synapse

Big Query

Redshift

Airflow

Job description

A leading consulting service firm is seeking a Cloud Data Engineer to optimize data pipelines and design data solutions in a Databricks environment. The ideal candidate will have strong programming skills in Python and SQL, with experience in data warehousing and ETL processes. This role requires collaboration with business users and analysts, making expertise in data integration and cloud services essential.