Python Pyspark Developer

Lancesoft

Montreal

On-site

CAD 90,000 - 130,000

Full time

5 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Lancesoft is seeking a data engineer in Montreal to design and implement robust data pipelines using Python and Spark. You will optimize SQL queries, manage large datasets, and collaborate with cross-functional teams on cloud-based data solutions.

The role focuses on ETL/ELT workflows, data modeling, and modern data warehousing concepts, with exposure to Databricks, Delta Lake, and orchestration tools. Montreal-based hybrid work possible.

Qualifications

  • Strong programming experience in Python 3.x, including OOP and data structures.
  • Hands-on experience with PySpark and Spark ecosystem.
  • Strong SQL and relational database expertise.
  • Experience building ETL/ELT pipelines and large-scale data transforms.
  • Knowledge of distributed computing and big data architectures.

Skills

Python
SQL
Spark
ETL/ELT pipelines
Data modeling
Distributed computing

Tools

PySpark
Spark SQL
Parquet
Avro
JSON
CSV
ORC
PostgreSQL
MySQL
SQL Server
Oracle
AWS
Azure
GCP
Git
Jenkins
Azure DevOps
GitHub Actions
Docker
Kubernetes
Airflow
Databricks
Delta Lake
Snowflake
BigQuery
Terraform

Job description

  • Strong programming experience in Python 3.x, including OOP, data structures, exception handling, and reusable modules.
  • Hands-on experience with PySpark, Apache Spark, Spark SQL, and Spark DataFrames.
  • Strong expertise in SQL, query optimization, and relational databases.
  • Experience developing ETL/ELT pipelines and large-scale data transformation workflows.
  • Knowledge of distributed computing, parallel processing, and big data architecture.
  • Experience with data formats such as Parquet, Avro, JSON, CSV, and ORC.
  • Experience with databases such as PostgreSQL, SQL Server, Oracle, MySQL, or similar.
  • Hands-on experience with cloud platforms (AWS/Azure/GCP).
  • Knowledge of Git, Jenkins, Azure DevOps, GitHub Actions, or other CI/CD tools.
Preferred / Nice-to-Have Skills
  • Experience with Databricks, Delta Lake, and Lakehouse architecture.
  • Knowledge of Snowflake, Amazon Redshift, Azure Synapse Analytics, or BigQuery.
  • Experience with Apache Kafka and real-time streaming.
  • Knowledge of Apache Airflow, AWS Glue, Azure Data Factory, or similar orchestration tools.
  • Experience with Docker and Kubernetes.
  • Understanding of data modeling, dimensional modeling, and data warehousing concepts.
  • Experience with Terraform and cloud infrastructure automation.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Java Spark Developer
Java Spark Developer

Lancesoft • Montreal

On-site
CAD 110,000 - 140,000
Python/PySpark Developer
Python/PySpark Developer

Compunnel Inc. • Mississauga

Remote
CAD 90,000 - 120,000
Senior Python PySpark Data Engineer – Databricks
Senior Python PySpark Data Engineer – Databricks

Compunnel Inc. • Mississauga

Remote
CAD 90,000 - 120,000
Senior Python Developer with PySpark and AWS
Senior Python Developer with PySpark and AWS

Luxoft Holding • Toronto

On-site
CAD 90,000 - 130,000
Spark Developer (With Java)
Spark Developer (With Java)

Capgemini • Mississauga

On-site
CAD 90,000 - 130,000
Senior Python/PySpark Engineer for AWS Data Platform
Senior Python/PySpark Engineer for AWS Data Platform

Luxoft • Toronto

On-site
CAD 90,000 - 130,000
Core Java, Apache Spark, Python
Core Java, Apache Spark, Python

PeoplePilot • Montreal

On-site
CAD 110,000 - 140,000
Big Data Engineer (PySpark / Spark / Kafka)
Big Data Engineer (PySpark / Spark / Kafka)

Astra-North Infoteck Inc. • Toronto

Hybrid
CAD 100,000 - 150,000
Azure Data Engineer
Azure Data Engineer

Rivago Infotech Inc • Toronto

On-site
CAD 90,000 - 150,000
Azure Cloud Data Engineer
Azure Cloud Data Engineer

Compunnel Inc. • Mississauga

On-site
CAD 100,000 - 130,000