Azure Data Ingestion Engineer - Hybrid (IDMC/Databricks)

Brainhunter Systems Ltd

Toronto

Hybrid

CAD 90,000 - 130,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Brainhunter Systems Ltd is seeking a Data Ingestion Engineer for a contract opportunity with one of our valued clients. The role is hybrid with 3 days in the office and reliability clearance is required.

You will design, implement, and maintain data ingestion pipelines using Informatica IDMC on the MS Azure platform with Azure Data Factory and Databricks, ensuring data quality and reliability across sources.

Qualifications

  • 5+ years in data operations or development (ETL, Data Warehouse).
  • 2+ years recent development with IDMC, Azure and Databricks.
  • Experience designing data ingestion pipelines on Azure platform.

Responsibilities

  • Design, develop, test, and support end-to-end ingestion pipelines using IDMC in MS Azure.
  • Collaborate with cross functional teams to understand data requirements and workflows.
  • Implement and maintain controls/alerts to monitor pipelines for data quality and integrity.
  • Triage incidents with support to resolve outages or disruptions.
  • Automate processes to improve reliability, scalability and cost efficiency.
  • Document system configurations and troubleshooting procedures.

Skills

Python
SQL
Troubleshooting
Problem solving

Tools

Informatica IDMC
Azure Data Factory
Azure Databricks
Kafka
CI/CD
CDC tools

Job description

Brainhunter Systems Ltd is seeking a Data Ingestion Engineer for a contract opportunity with one of our valued clients. The role is hybrid with 3 days in the office and reliability clearance is required.

You will design, implement, and maintain data ingestion pipelines using Informatica IDMC on the MS Azure platform with Azure Data Factory and Databricks, ensuring data quality and reliability across sources.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Azure Data Ingestion Engineer (IDMC/Databricks)
Senior Azure Data Ingestion Engineer (IDMC/Databricks)

Brainhunter Systems Ltd • Toronto

On-site
CAD 90,000 - 130,000
“Data Ingestion Engineer\"
“Data Ingestion Engineer\"

Brainhunter Systems Ltd • Toronto

Hybrid
CAD 90,000 - 130,000
Hybrid Azure Data Science Engineer: Databricks & Pipelines
Hybrid Azure Data Science Engineer: Databricks & Pipelines

HRBrain Inc. • Toronto

Hybrid
CAD 90,000 - 140,000
Hybrid work model
Azure Data Engineer
Azure Data Engineer

Astra-North Infoteck Inc. • Toronto

Hybrid
CAD 120,000 - 170,000
Azure Data Engineer
Azure Data Engineer

Astra-North Infoteck Inc. • Toronto

Hybrid
CAD 100,000 - 130,000
Data Ingestion Engineer
Data Ingestion Engineer

Brainhunter Systems Ltd • Toronto

On-site
CAD 90,000 - 130,000
ETL & Data Ingestion Engineer
ETL & Data Ingestion Engineer

Brainhunter Systems Ltd • Toronto

Hybrid
CAD 70,000 - 117,000
Hybrid work arrangement
Cloud Platform Engineer-Databricks
Cloud Platform Engineer-Databricks

BeachHead • Toronto

On-site
CAD 120,000 - 180,000
Azure Databricks DevOps Engineer - Hybrid & CI/CD
Azure Databricks DevOps Engineer - Hybrid & CI/CD

Cpus Engineering Staffing Solutions Inc. • Oshawa

Hybrid
CAD 124,000 - 131,000
Azure Data Bricks Consultant
Azure Data Bricks Consultant

Compunnel Inc. • Toronto

On-site
CAD 110,000 - 170,000