Data Engineer: Petabyte-Scale Pipelines on AWS (Python)

HRB; Remote; CAD 80,000 - 120,000; Full time

Job summary

An established industry player is on the lookout for a skilled Data Engineer to join their dynamic team. In this role, you'll design and optimize large-scale data pipelines, leveraging cutting-edge AWS services to handle massive datasets. You'll collaborate with talented engineers and data experts, ensuring data reliability and performance while exploring exciting opportunities in video processing. This position offers a competitive salary, benefits, and a chance for career growth in a collaborative environment focused on innovation and excellence in data-driven applications.

Benefits

Competitive compensation

Career growth opportunities

Collaborative environment

Diverse team of experts

Qualifications

• Strong coding skills in Python for data manipulation and analysis.
• Hands-on experience with AWS services like S3 and EC2.

Responsibilities

• Design and maintain scalable data pipelines in Python.
• Leverage AWS services for data storage and processing.

Skills

Python

AWS (S3, EC2)

Big Data Handling

SQL

NoSQL

CI/CD Pipelines

Tools

Airflow

Luigi

Job description

An established industry player is on the lookout for a skilled Data Engineer to join their dynamic team. In this role, you'll design and optimize large-scale data pipelines, leveraging cutting-edge AWS services to handle massive datasets. You'll collaborate with talented engineers and data experts, ensuring data reliability and performance while exploring exciting opportunities in video processing. This position offers a competitive salary, benefits, and a chance for career growth in a collaborative environment focused on innovation and excellence in data-driven applications.