Senior Data Engineer - Data Platform

Jobgether; India; Remote; INR 1,500,000 - 2,700,000; Full time

Benefits offered by this job

Worldwide remote work

Fixed-term contract

Start as soon as possible

Professional development

Exposure to modern technologies and EA

Collaborative agile environment

Job summary

Jobgether, on behalf of a partner company, seeks a Senior Data Engineer – Data Platform based in India. You will design and operate a modern data platform on Microsoft Azure, building scalable data pipelines with Databricks, SQL, Python and Spark, using Data Vault 2.0 and dbt Core, and automating workflows with CI/CD in agile teams.

The ideal candidate has 5+ years of data engineering experience, strong cloud and data modeling skills, Git and testing practices, and fluency in English and German.

Qualifications

• At least 5 years of professional experience in data engineering.
• Strong hands-on experience with Databricks, SQL, Python, Apache Spark, and PySpark.
• Proven experience designing, developing, and operating scalable data pipelines.
• Advanced knowledge of dbt Core, particularly within Databricks environments.
• Solid experience with data modeling based on Data Vault 2.0.
• Experience with historical data models, dimensional modeling, data quality testing, and data documentation.
• Excellent knowledge of Git, CI/CD pipelines, and automated testing practices.
• Practical experience operating data solutions in Microsoft Azure.
• Several years of experience working in a corporate environment.
• Strong analytical and problem-solving skills, with the ability to independently understand and resolve complex technical issues.
• An independent, structured, and goal-oriented approach to work.
• High willingness to learn and adaptability in a dynamic environment.
• Experience with agile methodologies; knowledge of SAFe is an advantage.
• Fluent German and English communication skills.

Responsibilities

• Further develop, maintain, and operate a modern data platform built on Databricks.
• Design, develop, optimize, and maintain scalable data pipelines and data products.
• Implement robust data models following Data Vault 2.0 principles.
• Develop and manage data transformations using dbt Core on Databricks.
• Establish and maintain data quality, testing, and validation processes to ensure data accuracy and consistency.
• Ensure the stable, high-performance, and cost-efficient operation of data solutions within Microsoft Azure.
• Work with historical data models, dimensional modeling, and data documentation practices.
• Contribute to agile project and product teams, collaborating with stakeholders to deliver data engineering solutions.
• Support the automation of development, testing, and deployment workflows using CI/CD pipelines.
• Apply best practices in version control, automated testing, and continuous integration to improve engineering efficiency.

Skills

Databricks

SQL

Python

Apache Spark

PySpark

Git

CI/CD

Automated Testing

Tools

Databricks

dbt Core

Azure

Data Vault 2.0

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer – Data Platform based in India.

As a Senior Data Engineer – Data Platform, you will play a key role in developing and operating a modern, scalable data platform within a Microsoft Azure environment. You will design and optimize data pipelines and data products using Databricks, Python, SQL, and Apache Spark. Working with Data Vault 2.0 and dbt Core, you will ensure reliable data transformations, high-quality data models, and robust validation processes. You will also contribute to automating development and deployment workflows through CI/CD practices. Collaborating with agile project and product teams, you will help deliver efficient, secure, and cost-effective data solutions. This role offers the opportunity to tackle complex data engineering challenges in a dynamic corporate environment.

Accountabilities

You will contribute to the continuous improvement and reliable operation of the organization's data platform, ensuring that data solutions remain scalable, efficient, and aligned with business requirements. Your responsibilities will include:

• Further develop, maintain, and operate a modern data platform built on Databricks.
• Design, develop, optimize, and maintain scalable data pipelines and data products.
• Implement robust data models following Data Vault 2.0 principles.
• Develop and manage data transformations using dbt Core on Databricks.
• Establish and maintain data quality, testing, and validation processes to ensure data accuracy and consistency.
• Ensure the stable, high-performance, and cost-efficient operation of data solutions within Microsoft Azure.
• Work with historical data models, dimensional modeling, and data documentation practices.
• Contribute to agile project and product teams, collaborating with stakeholders to deliver data engineering solutions.
• Support the automation of development, testing, and deployment workflows using CI/CD pipelines.
• Apply best practices in version control, automated testing, and continuous integration to improve engineering efficiency.

Requirements

The ideal candidate is an experienced data engineering professional with strong technical expertise in modern data platforms, cloud environments, and scalable data architecture. You should be comfortable working independently, solving complex technical challenges, and collaborating within an agile corporate environment. The following qualifications are required:

• At least 5 years of professional experience in data engineering.
• Strong hands‑on experience with Databricks, SQL, Python, Apache Spark, and PySpark.
• Proven experience designing, developing, and operating scalable data pipelines.
• Advanced knowledge of dbt Core, particularly within Databricks environments.
• Solid experience with data modeling based on Data Vault 2.0.
• Experience with historical data models, dimensional modeling, data quality testing, and data documentation.
• Excellent knowledge of Git, CI/CD pipelines, and automated testing practices.
• Practical experience operating data solutions in Microsoft Azure.
• Several years of experience working in a corporate environment.
• Strong analytical and problem-solving skills, with the ability to independently understand and resolve complex technical issues.
• An independent, structured, and goal-oriented approach to work.
• High willingness to learn and adaptability in a dynamic environment.
• Experience with agile methodologies; knowledge of SAFe is an advantage.
• Fluent German and English communication skills.

Additional qualifications that would be an advantage:

Previous experience in the health insurance sector.

Benefits

• Remote Work: Worldwide remote working opportunity.
• Contract Type: Fixed‑term employment contract.
• Start Date: As soon as possible.
• Professional Development: Opportunity to work with modern data engineering technologies, including Databricks, Azure, dbt Core, and Apache Spark.
• Technical Challenges: Exposure to complex data architecture, large-scale data pipelines, and enterprise data platform development.
• Collaborative Environment: Work alongside agile project and product teams on impactful data initiatives.