Data Engineer-6

Realign Llc

Toronto

On-site

CAD 90,000 - 130,000

Full time

7 hours ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Realign Llc in Toronto, Canada is seeking a seasoned Data Engineer to design and implement scalable data pipelines and modern data lake solutions on AWS. The role emphasizes banking and financial services domain expertise and hands-on work with Redshift, S3, Glue, and Lambda.

The ideal candidate will drive data migration from IBM Netezza to AWS, ensure data quality and governance, and collaborate with stakeholders to deliver robust data platforms.

Qualifications

12+ years of experience in data engineering/data warehousing.
Strong banking and financial services domain experience.
Hands-on expertise with AWS data stack: S3, Glue, Lambda, Redshift.
Experience with IBM Netezza migration to AWS environments.
Knowledge of Kafka, Spark, and batch data processing.

Responsibilities

Design, develop, and maintain scalable data pipelines and workflows on AWS.
Build and manage data lakes and data warehouses using Amazon S3 and Redshift.
Develop ETL/ELT processes using AWS Glue, Lambda, Spark, and related technologies.
Implement Kafka message processing, batch data ingestion, and business-layer data processing.
Optimize data ingestion, transformation, and loading processes.
Ensure data quality, governance, security, performance, and scalability.
Monitor and troubleshoot data pipelines and workflows using AWS services.
Automate deployments through CI/CD pipelines.
Collaborate with clients, data users, and stakeholders to understand requirements.
Develop reusable data engineering frameworks and design patterns.
Perform data onboarding using established frameworks.
Analyze existing IBM Netezza code and design migration solutions for AWS Data Lake.
Develop unit tests and support QA, SIT, and performance testing.
Support migration and deployment of solutions into production.

Skills

Data engineering

Data warehousing

AWS data services

Amazon Redshift

Amazon S3

AWS Glue

AWS Lambda

Kafka

Spark

ETL/ELT pipelines

Netezza migration

CI/CD

Data governance

Tools

AWS Step Functions

IAM

CloudWatch

Airflow

Snowflake

Databricks

Delta Lake

Job description

Job Title: Data Engineer
Job Type: Full Time
Location: Toronto, ON (Onsite)

Job Description

We are seeking an experienced Data Engineer with strong data warehouse expertise and extensive experience in the banking and financial services domain. The ideal candidate will have 12+ years of experience in data engineering and hands-on expertise designing and developing scalable data pipelines, data lakes, and data warehouses on AWS.

Key Responsibilities

Design, develop, and maintain scalable data pipelines and workflows on AWS
Build and manage data lakes and data warehouses using Amazon S3 and Redshift
Develop ETL/ELT processes using AWS Glue, Lambda, Spark, and related technologies
Implement Kafka message processing, batch data ingestion, and business-layer data processing
Optimize data ingestion, transformation, and loading processes
Ensure data quality, governance, security, performance, and scalability
Monitor and troubleshoot data pipelines and workflows using AWS services
Automate deployments through CI/CD pipelines
Collaborate with clients, data users, and stakeholders to understand requirements
Develop reusable data engineering frameworks and design patterns
Perform data onboarding using established frameworks
Analyze existing IBM Netezza code and design migration solutions for AWS Data Lake
Develop unit tests and support QA, SIT, and performance testing
Support migration and deployment of solutions into production