Senior Data Engineer: AWS Big Data & Real-Time Pipelines

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!; Toronto; On-site; CAD 120,000 - 180,000; Full time

Job summary

Astra-North Infoteck Inc. is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines on AWS. You will work on data platform modernization, cloud migrations, and real-time data processing in a fast-paced enterprise environment.

We require 10+ years in Data Engineering, with hands-on Netezza experience and strong AWS skills (EMR, S3, Redshift, Glue). Proficiency in SQL, Python, and Airflow is highly valued.

Qualifications

• 10+ years of experience in Data Engineering / Big Data / Platform Engineering.
• Netezza experience is mandatory.
• Strong experience with AWS Cloud services (EMR, S3, EC2, Redshift, Glue).
• Experience with ETL/ELT tooling (SSIS, Pentaho) and data warehousing.

Responsibilities

• Design, develop, maintain, and support scalable data pipelines and distributed systems.
• Lead data platform migrations from On-Prem to AWS, ideally with Netezza background.
• Develop and manage ETL/ELT processes using SSIS, Pentaho, or similar tools.
• Implement and manage AWS services (EMR, S3, EC2, Redshift, Glue, Airflow).
• Build and optimize data workflows and orchestration pipelines using Airflow.
• Work with real-time streaming technologies (Kafka, Spark Streaming).
• Ingest, transform, and validate data from multiple sources; optimize SQL queries.
• Monitor performance, troubleshoot issues, and ensure reliability.

Skills

SQL

Shell scripting

Python

Unix/Linux

Tools

AWS (EMR, EC2, S3, Redshift, Glue)

Airflow

Netezza

SSIS

Pentaho

Job description

Astra-North Infoteck Inc. is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines on AWS. You will work on data platform modernization, cloud migrations, and real-time data processing in a fast-paced enterprise environment.

We require 10+ years in Data Engineering, with hands-on Netezza experience and strong AWS skills (EMR, S3, Redshift, Glue). Proficiency in SQL, Python, and Airflow is highly valued.