Senior Data Engineer

Iris Software Inc.; Toronto; On-site; CAD 120,000 - 160,000; Full time

Job summary

Iris Software Inc. is seeking a Senior Data Engineer to lead the migration of enterprise data platforms from Netezza and SSIS to AWS-native architectures. You will drive ETL/ELT patterns, ensure data quality and governance, and optimize Redshift workloads in a cloud-first environment.

You will provide hands-on architecture leadership across AWS services, collaborating with risk, analytics, and data science teams to enable data-driven insights and reporting at scale.

Responsibilities

• Lead migration of enterprise data platforms from Netezza and SSIS to AWS-native architectures using Glue, PySpark, S3, Redshift, and Lambda.
• Design, develop, and validate scalable ETL/ELT migration patterns with parity and performance optimization.
• Provide hands-on architecture leadership across AWS services, including coding, troubleshooting and tuning.
• Own end-to-end data migration and reconciliation with source-to-target validation and data completeness checks.
• Design robust data quality, lineage, and governance controls to support risk and compliance requirements.
• Optimize Redshift data models, workload management, and query performance for large-scale workloads.
• Develop AWS Glue and PySpark pipelines for ingestion, transformation, enrichment, and orchestration.
• Modernize legacy Netezza SQL and SSIS workflows into cloud-native solutions.
• Enforce PII protection and secure data handling throughout migration lifecycle.
• Collaborate with risk, analytics, and data science teams to enable data consumption for models and reporting.
• Implement CI/CD and workflow orchestration using Airflow or Glue Workflows for reliable production ops.
• Provide technical leadership and architecture governance to deliver large-scale migration initiatives.

Tools

AWS Glue

PySpark

S3

Redshift

Lambda

Airflow

Netezza

SSIS

Job description

Iris's Fortune 100 direct client is looking for Senior Data Engineer.

Key Responsibilities

• Lead the migration of enterprise data platforms from Netezza and SSIS to AWS-native data architectures using Glue, PySpark, S3, Redshift, and Lambda.
• Design, develop, and validate scalable ETL/ELT migration patterns, ensuring functional parity and performance optimization between legacy and target platforms.
• Provide hands-on architecture leadership with active involvement in data engineering, coding, troubleshooting, and performance tuning across AWS services.
• Own end-to-end data migration and reconciliation strategy, including source-to-target validation, data completeness checks, and exception management.
• Design and implement robust data quality, auditability, lineage, and regulatory reporting controls to support enterprise risk and compliance requirements.
• Optimize Amazon Redshift data models, schema design, workload management, and query performance for large-scale reporting and batch processing workloads.
• Develop and enhance AWS Glue and PySpark pipelines for data ingestion, transformation, enrichment, and orchestration across multiple source systems.
• Lead the modernization of legacy Netezza SQL, nz_unload processes, and SSIS workflows, ensuring efficient conversion to cloud-native solutions.
• Define and enforce PII protection, encryption standards, data governance policies, and secure data handling practices throughout the migration lifecycle.
• Collaborate with risk, analytics, and data science teams to enable data consumption for risk models, scoring engines, model inference pipelines, and reporting platforms.
• Implement and support CI/CD, deployment automation, and workflow orchestration using Airflow, Glue Workflows, or equivalent tools to ensure reliable production operations.
• Provide technical leadership, code reviews, architecture governance, and best-practice guidance while ensuring successful delivery of large-scale Netezza-to-AWS migration initiatives.

About Iris Software Inc.

With 4,000+ associates and offices in India, U.S.A. and Canada, Iris Software delivers technology services and solutions that help clients complete fast, far-reaching digital transformations and achieve their business goals. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge technology, and flexible engagement models. High customer satisfaction has translated into long-standing relationships and preferred-partner status with many of our clients, who rely on our 30+ years of technical and domain expertise to future-proof their enterprises. Associates of Iris work on mission-critical applications supported by a workplace culture that has won numerous awards in the last few years, including Certified Great Place to Work in India; Top 25 GPW in IT & IT-BPM; Ambition Box Best Place to Work, #3 in IT/ITES; and Top Workplace NJ-USA.