Data Engineer

Swoon; Toronto; Hybrid; Full time

Job summary

A leading company is seeking a Senior AWS ETL Developer with extensive experience in data engineering. This hybrid role involves building scalable data pipelines using AWS technologies. The ideal candidate will have expertise in AWS Glue, PySpark, and performance tuning. Join a dynamic team to enhance data solutions in a collaborative environment.

Qualifications

• 10+ years in data engineering or software development.
• Proven experience in stress testing and performance tuning.

Responsibilities

• Build and manage ETL pipelines using AWS Glue, PySpark, and Python.
• Optimize performance in Redshift or SQL Server.
• Collaborate with cross-functional teams to deliver robust data solutions.

Skills

AWS Glue

Lambda

Python

PySpark

SQL

Job description

Direct message the job poster from Swoon

Senior Recruiter @ Swoon helping organizations grow one talent at a time. | Empathy-Driven

Job Title: AWS ETL Developer

Hybrid: Downtown Toronto (Tuesday & Thursday), Remote other days

Contract length: 6 months to start, extendable, multi-year journey

Pay Rate: $80-93/hour T4; $90-110/hour Incorporated

Overview:

We’re looking for a Senior AWS ETL Developer with 10+ years of experience in data engineering to build and optimize scalable, cloud-based data pipelines. This role requires deep expertise in AWS Glue, PySpark, Lambda, Python, and either Amazon Redshift or SQL Server. Experience with data modeling, stress testing, and performance tuning is essential.

Responsibilities:

• Build and manage ETL pipelines using AWS Glue, PySpark, and Python
• Develop event-driven data processes with Lambda
• Optimize performance in Redshift or SQL Server
• Conduct stress testing and performance benchmarking
• Design data models and manage schema evolution
• Automate and monitor workflows using CloudWatch
• Collaborate with cross-functional teams to deliver robust data solutions

Required Skills:

• 10+ years in data engineering or software development
• Strong in AWS Glue, Lambda, Redshift, Python, and PySpark
• Solid SQL skills (Redshift or SQL Server)
• Proven experience in stress testing and performance tuning
• Familiarity with CI/CD tools (e.g., Git, Bitbucket)

Nice to Have:

• Banking experience
• C#/.NET, PowerShell scripting
• Experience in enterprise data environments

ETL | AWS Glue | Lambda | PySpark | Python | Redshift | SQL Server | Hadoop (nice to have)

Seniority level

• Mid-Senior level

Employment type

• Contract

Job function

• Information Technology

Industries

• Banking