Data Engineer – Databricks & MDM

Teqfocus

Toronto

Presencial

CAD 110 000 - 150 000

Tempo integral

há 11 horas
Torna-te num dos primeiros candidatos

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

Teqfocus is a Data and AI company delivering scalable data integration solutions. We seek a hands-on Data Engineer with 5+ years of experience to design and deliver ETL/ELT pipelines, focusing on Databricks, PySpark, SQL and Python.

You will transform data into complex JSON structures and integrate with Reltio MDM via REST APIs. The role emphasizes building dependable pipelines, ensuring data quality and accurate master data ingestion.

Qualificações

  • 5+ years of professional experience in data engineering, data integration or ETL/ELT development.
  • Databricks & PySpark: Hands-on experience extracting, reading and processing data using PySpark and SQL.
  • Python & JSON: Strong Python proficiency building transformations to complex, nested JSON payloads.
  • REST API Integration: Experience integrating data platforms with external systems via REST APIs.
  • Reltio MDM: Knowledge of data model, entities, attributes, relationships and ingestion APIs.
  • ETL/ELT Pipeline Development: Building robust pipelines with bulk and incremental loads & validation.
  • Strong SQL skills, data troubleshooting and cross-team collaboration.

Responsabilidades

  • Read, extract and process data from Databricks (Delta Lake) using PySpark and SQL.
  • Develop Python transformations to create complex, nested JSON payloads.
  • Integrate Databricks and other platforms with external applications via REST APIs.
  • Work with Reltio MDM data models and ingestion APIs.
  • Design and maintain ETL/ELT pipelines with source-to-target mapping and validation.
  • Implement logging, data-quality checks and troubleshooting across workflows.

Conhecimentos

REST API Integration
Reltio MDM
ETL/ELT Pipeline Development
Data Troubleshooting
Collaboration with teams

Ferramentas

Databricks
PySpark
SQL
Python
JSON Payloads

Descrição da oferta de emprego

We are seeking a hands-on Data Engineer with 5+ years of experience to design and deliver scalable data integration solutions. The ideal candidate has strong expertise in Databricks, PySpark, SQL and Python, with proven experience transforming data into complex JSON structures and integrating with Reltio MDM through REST APIs. The role focuses on building dependable ETL/ELT pipelines, ensuring data quality and supporting accurate master data ingestion.

About Teqfocus:

Teqfocus is a Data and AI company that helps enterprises build and scale the Agentic Enterprise — connecting the data foundation, the intelligence layer, and the applications teams run their businesses on into a single, coherent architecture.

As a Salesforce Summit Partner, we work in Healthcare, Life Sciences, Financial Services, Insurance, and Hi-Tech — industries where getting AI right matters and the tolerance for failure is low. Our delivery model is senior-heavy by design. The same team that scopes an engagement ships it to production. There are no junior shadow teams, no sub-contractors brought in when the problem gets hard, and no hand-off to a separate managed services vendor when the project closes.

We run an internal innovation practice that builds the reusable patterns, pre-tested architectures, and industry-specific frameworks that give every Teqfocus client a head start — and give every Teqfocus practitioner work that compounds over time.

We are a diverse, immigrant-entrepreneurial company. We were built on the conviction that the best outcomes come from people who take genuine ownership of what they build — and are trusted to do so.

www.teqfocus.com

Key Responsibilities:
  • Read, extract and process data from Databricks, including Delta Lake tables and data layers, using PySpark and SQL.
  • Develop Python transformations to convert structured source datasets into complex, nested JSON payloads aligned to target data models.
  • Integrate Databricks and other data platforms with external applications through REST APIs, managing authentication, payloads, response handling, errors and retries.
  • Work hands-on with Reltio MDM data models, entity types, attributes and relationships; build and support ingestion through Reltio APIs.
  • Design and maintain ETL/ELT pipelines for bulk and incremental loads, including source-to-target mapping, validation and reconciliation.
  • Implement robust logging, exception handling, data-quality checks and troubleshooting across integration and ingestion workflows.
Required Skills & Qualifications:
  • 5+ years of professional experience in data engineering, data integration or ETL/ELT development.
  • Databricks & PySpark: Hands-on experience extracting, reading and processing data from Databricks (Delta Lake/data layers) using PySpark and SQL.
  • Python & JSON: Strong Python proficiency building transformations from structured datasets into complex, nested JSON payloads based on target data models.
  • REST API Integration: Practical experience integrating data platforms with external systems using REST APIs, including authentication, payload handling, error management and retry mechanisms.
  • Reltio MDM: Hands-on knowledge of its data model, entity types, attributes, relationships and data ingestion APIs.
  • ETL/ELT Pipeline Development: Experience building robust pipelines with bulk and incremental loads, source-to-target data mapping, validation, reconciliation and error handling.
  • Strong SQL skills, data troubleshooting capabilities and ability to collaborate across engineering and business teams.
Good to Have:
  • Experience with Databricks workflows/jobs, Spark optimization and pipeline monitoring.
  • Familiarity with MDM match/merge, survivorship rules, data governance and master data quality practices.
  • Experience working with API-based ingestion at scale and ensuring reliable operational observability.
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

MDM Senior Developer + Databricks
MDM Senior Developer + Databricks

Compunnel Inc. • Mississauga

Presencial
CAD 100 000 - 130 000
Senior MDM Developer — Databricks on Azure
Senior MDM Developer — Databricks on Azure

Compunnel Inc. • Mississauga

Presencial
CAD 100 000 - 130 000
Data Engineering Expert
Data Engineering Expert

Vooban • Montreal , Quebec

Presencial
CAD 75 000 - 120 000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Raise - find a more meaningful working experience • Toronto

Híbrido
CAD 100 000 - 167 000
Data Engineering Tech Lead
Data Engineering Tech Lead

Vooban • Quebec

Presencial
CAD 120 000 - 150 000
Lead/Senior Data Engineer
Lead/Senior Data Engineer

Celebal Technologies • Ottawa

Presencial
CAD 110 000 - 160 000
Senior Python PySpark Data Engineer – Databricks
Senior Python PySpark Data Engineer – Databricks

Compunnel Inc. • Mississauga

Teletrabalho
CAD 90 000 - 120 000
Databricks Engineer
Databricks Engineer

Compunnel Inc. • Mississauga

Presencial
CAD 120 000 - 150 000
Senior AWS Data Engineer (Strong Databricks)
Senior AWS Data Engineer (Strong Databricks)

Ccube • Mississauga

Híbrido
CAD 120 000 - 170 000
Data Engineer
Data Engineer

Spectraforce • Toronto

Híbrido
CAD 80 000 - 110 000