Senior Data Engineer: Lakehouse & Iceberg Expert

Iris Software Inc.; Toronto; On-site; CAD 110,000 - 150,000; Full time

Job summary

Iris Software Inc. in Toronto seeks a Senior Data Engineer to design and optimize production-grade data pipelines and data products on lakehouse platforms using Apache Iceberg.

You will build logical and physical data models, implement batch and real-time ingestion with Spark/PySpark and Kafka, manage Iceberg schemas, and ensure data quality, governance, and regulatory reporting. This role requires strong collaboration with architects and stakeholders.

Qualifications

• 10+ years in data engineering, data modeling and warehousing.
• Experience building large-scale data transformation initiatives.
• Proficiency with modern lakehouse platforms and governance.

Responsibilities

• Design, develop, and optimize production-grade data pipelines and data products.
• Create enterprise data models to support analytical and regulatory reporting.
• Develop batch and real-time ingestion using Spark/PySpark and Kafka.
• Define Iceberg table structures, partitioning, and schema evolution.
• Implement CDC, upserts, and time-travel data management patterns.
• Drive data quality controls and regulatory compliance requirements.

Skills

Data Engineering

Data Modeling

Data Warehousing

Batch & Real-time Pipelines

Iceberg

Spark/PySpark

Kafka

Regulatory/Compliance Awareness

Tools

Apache Iceberg

Spark

Kafka

Job description

Iris Software Inc. in Toronto seeks a Senior Data Engineer to design and optimize production-grade data pipelines and data products on lakehouse platforms using Apache Iceberg.

You will build logical and physical data models, implement batch and real-time ingestion with Spark/PySpark and Kafka, manage Iceberg schemas, and ensure data quality, governance, and regulatory reporting. This role requires strong collaboration with architects and stakeholders.