Senior Data Engineer - Data Platform

Jobgether; Canada; Remote; CAD 110,000 - 150,000; Full time

Benefits offered by this job

Remote work worldwide

Fixed-term contract

Start date ASAP

Professional development with modern数据

Job summary

Jobgether is seeking a Senior Data Engineer – Data Platform based in Canada to design, build, and operate a scalable data platform in Azure using Databricks, SQL, Python, Spark, and PySpark.

You will implement Data Vault 2.0 models, develop dbt Core transformations, and ensure data quality with CI/CD workflows while collaborating with agile teams in a fast-paced corporate environment.

Qualifications

• At least 5 years of professional experience in data engineering.
• Strong hands-on experience with Databricks, SQL, Python, Apache Spark, and PySpark.
• Proven experience designing, developing, and operating scalable data pipelines.
• Advanced knowledge of dbt Core, particularly within Databricks environments.
• Solid experience with data modeling based on Data Vault 2.0.
• Experience with historical data models, dimensional modeling, data quality testing, and data documentation.
• Excellent knowledge of Git, CI/CD pipelines, and automated testing practices.
• Practical experience operating data solutions in Microsoft Azure.
• Several years of experience working in a corporate environment.
• Strong analytical and problem-solving skills, with the ability to independently understand and resolve complex technical issues.
• An independent, structured, and goal-oriented approach to work.
• High willingness to learn and adaptability in a dynamic environment.
• Experience with agile methodologies; knowledge of SAFe is an advantage.
• Fluent German and English communication skills.

Responsibilities

• You will contribute to the continuous improvement and reliable operation of the organization's data platform, ensuring scalable and efficient data solutions.
• Develop, operate, and maintain a modern data platform built on Databricks.
• Design, develop, optimize, and maintain scalable data pipelines and data products.
• Implement robust data models following Data Vault 2.0 principles.
• Develop and manage data transformations using dbt Core on Databricks.
• Establish data quality, testing, and validation processes for data accuracy.
• Ensure high-performance, cost-efficient operation of data solutions in Azure.
• Work with historical and dimensional models, and maintain data documentation.
• Collaborate with agile teams and stakeholders to deliver data engineering solutions.
• Support CI/CD automation for development, testing, and deployment workflows.

Skills

Databricks

SQL

Python

Apache Spark

PySpark

dbt Core

Git

CI/CD pipelines

Automated testing

Azure

Data Vault 2.0

SAFe knowledge

German language

English language

Tools

Databricks

dbt Core

Azure

Git

CI/CD

Apache Spark

Python

SQL

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer – Data Platform based in Canada.

As a Senior Data Engineer – Data Platform, you will play a key role in developing and operating a modern, scalable data platform within a Microsoft Azure environment. You will design and optimize data pipelines and data products using Databricks, Python, SQL, and Apache Spark. Working with Data Vault 2.0 and dbt Core, you will ensure reliable data transformations, high-quality data models, and robust validation processes. You will also contribute to automating development and deployment workflows through CI/CD practices. Collaborating with agile project and product teams, you will help deliver efficient, secure, and cost-effective data solutions. This role offers the opportunity to tackle complex data engineering challenges in a dynamic corporate environment.

Accountabilities

You will contribute to the continuous improvement and reliable operation of the organization's data platform, ensuring that data solutions remain scalable, efficient, and aligned with business requirements. Your responsibilities will include:

• Further develop, maintain, and operate a modern data platform built on Databricks.
• Design, develop, optimize, and maintain scalable data pipelines and data products.
• Implement robust data models following Data Vault 2.0 principles.
• Develop and manage data transformations using dbt Core on Databricks.
• Establish and maintain data quality, testing, and validation processes to ensure data accuracy and consistency.
• Ensure the stable, high-performance, and cost-efficient operation of data solutions within Microsoft Azure.
• Work with historical data models, dimensional modeling, and data documentation practices.
• Contribute to agile project and product teams, collaborating with stakeholders to deliver data engineering solutions.
• Support the automation of development, testing, and deployment workflows using CI/CD pipelines.
• Apply best practices in version control, automated testing, and continuous integration to improve engineering efficiency.

Requirements

The ideal candidate is an experienced data engineering professional with strong technical expertise in modern data platforms, cloud environments, and scalable data architecture. You should be comfortable working independently, solving complex technical challenges, and collaborating within an agile corporate environment. The following qualifications are required:

• At least 5 years of professional experience in data engineering.
• Strong hands-on experience with Databricks, SQL, Python, Apache Spark, and PySpark.
• Proven experience designing, developing, and operating scalable data pipelines.
• Advanced knowledge of dbt Core, particularly within Databricks environments.
• Solid experience with data modeling based on Data Vault 2.0.
• Experience with historical data models, dimensional modeling, data quality testing, and data documentation.
• Excellent knowledge of Git, CI/CD pipelines, and automated testing practices.
• Practical experience operating data solutions in Microsoft Azure.
• Several years of experience working in a corporate environment.
• Strong analytical and problem-solving skills, with the ability to independently understand and resolve complex technical issues.
• An independent, structured, and goal-oriented approach to work.
• High willingness to learn and adaptability in a dynamic environment.
• Experience with agile methodologies; knowledge of SAFe is an advantage.
• Fluent German and English communication skills.

Additional qualifications that would be an advantage:

• Previous experience in the health insurance sector.

Benefits

• Remote Work: Worldwide remote working opportunity.
• Contract Type: Fixed-term employment contract.
• Start Date: As soon as possible.
• Professional Development: Opportunity to work with modern data engineering technologies, including Databricks, Azure, dbt Core, and Apache Spark.
• Technical Challenges: Exposure to complex data architecture, large-scale data pipelines, and enterprise data platform development.
• Collaborative Environment: Work alongside agile project and product teams on impactful data initiatives.