Sr Data Engineer Databricks and Informatica

MethodHub; Brampton; Hybrid; CAD 100,000 - 160,000; Part time

Job summary

MethodHub in Brampton, ON is seeking a Sr Data Engineer specializing in Databricks and Informatica for a 6- to 12-month hybrid contract. You will design scalable data platforms, modernize ETL pipelines, and lead data governance across cloud environments.

Responsibilities include architectural leadership for batch and real-time data pipelines on Azure/AWS/GCP, migrating from Informatica PowerCenter/IICS/IDMC to Databricks, and collaborating with business and technical teams to deliver

Qualifications

• Design and implement scalable data platforms using Databricks Lakehouse, Delta Lake, Spark, and PySpark.
• Architect batch and real-time data pipelines on cloud platforms (Azure/AWS/GCP).
• Lead ETL modernization and migration from Informatica PowerCenter/IICS/IDMC to Databricks.
• Define data governance, security, performance optimization, and best practices.
• Collaborate with business and technical teams to deliver enterprise data solutions.

Responsibilities

• Design and implement scalable data platforms using Databricks Lakehouse| Delta Lake| Spark| and PySpark.Architect batch and real-time data pipelines on Azure/AWS/GCP.
• Lead ETL modernization and migration from Informatica PowerCenter/IICS/IDMC to Databricks.
• Define data governance| security| performance optimization| and best practices.
• Collaborate with business and technical teams to deliver enterprise data solutions.

Skills

Databricks

Spark

PySpark

SQL

Delta Lake

Unity Catalog

Informatica PowerCenter

IICS/IDMC

CI/CD

Git

Agile

Tools

Informatica PowerCenter

IICS

IDMC

Snowflake

Azure Synapse

Kafka

Delta Lake

Databricks

Spark

Job description

Job Title: Sr Data Engineer with strong Databricks and Informatica

Brampton, ON

Contract: 6 - 12 Months

Hybrid 4 days in Office

Job Description:

• Databricks Architect (with Informatica)-Databricks, Informatica PowerCenter and/or IICS/IDMC, Spark, PySpark, SQL, Delta Lake, Unity Catalog.


• Brampton, ON - Hybrid (4 Days WFO)


• Contract: 6-12 months

Role Descriptions:

• Design and implement scalable data platforms using Databricks Lakehouse| Delta Lake| Spark| and PySpark.Architect batch and real-time data pipelines on Azure/AWS/GCP.


• Lead ETL modernization and migration from Informatica PowerCenter/IICS/IDMC to Databricks.


• Define data governance| security| performance optimization| and best practices.


• Collaborate with business and technical teams to deliver enterprise data solutions.


• Required Skills:


• Strong expertise in Databricks| Spark| PySpark| SQL| Delta Lake| Unity Catalog.


• Hands-on experience with Informatica PowerCenter and/or IICS/IDMC.


• Experience in data warehousing| data modeling| and cloud platforms (Azure preferred).


• Knowledge of CI/CD| Git| and Agile methodologies.


• Preferred Skills:


• Databricks and Cloud certifications


• Experience with Snowflake| Azure Synapse| Kafka| or Data Governance tools.