AWS Data Engineer – Data Warehouse & Netezza Migration

Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!; Toronto; Hybrid; CAD 110,000 - 165,000; Full time

Job summary

Astra-North Infoteck Inc. in Toronto is seeking an AWS Data Engineer to lead the migration of Netezza workloads to a modern data lake and warehouse on AWS. You will design scalable data pipelines, optimize ETL/ELT processes, and collaborate with stakeholders across banking and finance domains.

The role requires strong data warehouse expertise, hands-on AWS experience (S3, Glue, Lambda, Redshift), and governance for secure data handling. Hybrid work 2 days in the office.

Qualifications

• Strong data warehouse and ETL/ELT design experience in banking/financial domain (5+ years).
• Migration experience from IBM Netezza to AWS data lake/warehouse.
• Develop ETL/ELT pipelines on AWS (Glue/Lambda/Spark) and manage data pipelines.

Responsibilities

• Design, build, and maintain scalable data pipelines and workflows on AWS.
• Migrate Netezza features to AWS Data Lake and Redshift with cost/ performance optimization.
• Ensure data quality, governance, and security compliance across pipelines.
• Collaborate with stakeholders to understand data requirements and deliver reusable design patterns.
• Monitor, troubleshoot, and optimize data ingestion, transformation, and loading processes.
• Automate deployments using CI/CD pipelines for reliable production releases.

Skills

Strong data warehouse knowledge

Bank domain experience

Tools

AWS S3

AWS Glue

AWS Lambda

Amazon Redshift

AWS Step Functions

AWS IAM & CloudWatch

IBM Netezza

Kafka

Airflow

Job description

AWS Data Engineer – Data Warehouse & Netezza Migration

Location: Toronto; Hybrid 2 days a week in office

Must-Have Skills

• Amazon S3 (Data Lake)
• AWS Glue (ETL)
• AWS Lambda
• Amazon Redshift
• AWS Step Functions
• AWS IAM & CloudWatch
• IBM Netezza

Role and Responsibilities

• Required to have strong data warehouse technical knowledge.
• Must have knowledge in Bank and financial domain (Minimum 5+ years of experience).
• Design, develop, and maintain scalable data pipelines and workflows on AWS Build and manage data lakes and data warehouses (e.g., S3, Redshift).
• Develop ETL/ELT processes using tools like AWS Glue, Lambda, or Spark Strong solution.
• Knowledge in AWS Cloud and hands on experience with ETL process (like Kafka message processing, batch interface data injection and other business layer process).
• Optimize data ingestion, transformation, and loading processes.
• Work with stakeholders to understand and deliver data requirements.
• Ensure data quality, governance, and security compliance.
• Monitor and troubleshoot data pipelines and workflows Automate deployments using CI/CD pipelines Improve performance, cost optimization, and scalability.
• Coordinate with clients, data users and key stakeholders to understand feature requirements needed merge them to create reusable design patterns.
• Data onboarding using the developed frameworks Understand and make sense of available code in Netezza to design a best way to implement its current features in AWS Data Lake.
• Unit test code and aid with QA/SIT/Perf testing Migration to production environment

Good to have

• AWS Certifications (Solutions Architect / Data Analytics)
• Experience with Airflow (or Managed Workflows for Apache Airflow - MWAA)
• Exposure to Snowflake, Databricks, or Delta Lake