Senior Spark Data Engineer – ETL, Databricks, Cloud

Zurich Insurance; Jakarta Timur; Hybrid; IDR 700,280,112 - 1,050,420,168; Full time

Job summary

Zurich Insurance is looking for a Data Engineer to transform raw data into usable formats for analysis. This role emphasizes designing ETL pipelines using Spark SQL and Python within Databricks while optimizing engineering workflows for performance.

The ideal candidate should have over 5 years of experience with SparkSQL and Python, alongside a strong proficiency in dimensional modeling. A hybrid working environment is offered to balance work and life.

Qualifications

• At least 5+ years’ experience with SparkSQL, Python and PySpark for data engineering workflow.
• Strong proficiency in dimensional modeling and star schema design for analytical workloads.
• Demonstrated ability to optimize engineering workflow jobs for performance and cost efficiency.

Responsibilities

• Design and implement ETL/ELT pipelines using Spark SQL and Python within Databricks Medallion architecture.
• Develop dimensional data models following star schema methodology.
• Optimize Spark SQL and DataFrame operations to maximize performance.

Skills

SparkSQL

Python

PySpark

Dimensional modeling

Automated testing

CI/CD pipelines

GitHub operations

Cloud data services

Visual Studio Code

Databricks platform

Job description

Zurich Insurance is looking for a Data Engineer to transform raw data into usable formats for analysis. This role emphasizes designing ETL pipelines using Spark SQL and Python within Databricks while optimizing engineering workflows for performance.

The ideal candidate should have over 5 years of experience with SparkSQL and Python, alongside a strong proficiency in dimensional modeling. A hybrid working environment is offered to balance work and life.