AWS Data Engineer(10+Years)

Quantum World Technologies Inc.; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

Quantum World Technologies Inc. is seeking a senior Data Engineer to design and optimize data pipelines in a cloud environment.

You will use Python and SQL to build robust ETL processes, work with AWS Glue, PySpark, S3, Redshift, and related services, and collaborate with data teams on warehousing and modeling.

Qualifications

• 10+ years of experience in Data Engineering.
• Strong hands-on experience with AWS cloud services.
• Excellent programming skills in Python and SQL.
• Strong experience with AWS Glue and PySpark.
• Experience with Amazon S3, Redshift, Athena, Lambda, EMR, and Step Functions.
• Strong knowledge of ETL/ELT concepts and data pipeline architecture.
• Experience with relational databases such as Oracle, SQL Server, PostgreSQL, DB2, or MySQL.
• Strong understanding of data warehousing, dimensional modeling, fact/dimension tables, and data lakes.
• Experience with Git and CI/CD.
• Strong troubleshooting, analytical, and communication skills.

Skills

Data engineering

Python

SQL

ETL/ELT concepts

Data pipeline architecture

Data warehousing concepts

Dimensional modeling

Troubleshooting

Analytical skills

Communication skills

Tools

AWS Glue

PySpark

Amazon S3

Redshift

Athena

Lambda

EMR

Step Functions

Git

CI/CD

Job description

• 10+ years of experience in Data Engineering.
• Strong hands-on experience with AWS cloud services.
• Excellent programming skills in Python and SQL.
• Strong experience with AWS Glue and PySpark.
• Experience with Amazon S3, Redshift, Athena, Lambda, EMR, and Step Functions.
• Strong knowledge of ETL/ELT concepts and data pipeline architecture.
• Experience with relational databases such as Oracle, SQL Server, PostgreSQL, DB2, or MySQL.
• Strong understanding of data warehousing, dimensional modeling, fact/dimension tables, and data lakes.
• Experience with Git and CI/CD.
• Strong troubleshooting, analytical, and communication skills.