Senior Data Engineer: Spark/PySpark on Databricks

Nicoll Curtin; Zürich; On-site; CHF 120,000 - 180,000; Full time

Job summary

Nicoll Curtin is seeking an experienced Senior Data Engineer to join a finance transformation team in Switzerland. You will build a new data processing engine atop Spark, primarily using Python, with optional Java/Scala if needed.

The role focuses on true software development, not just ETL, and may require relocation to Switzerland. The project targets cloud-based, Azure Databricks-based data processing and integration services within a regulated financial services environment.

Qualifications

• Experience with Spark or PySpark in a hands-on software engineering role.
• Strong Python background, with willingness to work in Python rather than JVM only.
• Experience with Databricks and cloud-based data platforms is a plus.

Responsibilities

• Contribute to a greenfield data processing engine on Spark within Azure Databricks.
• Develop software rather than pure ETL pipelines in a regulated industry context.
• Support a large-scale finance transformation migrating systems to the cloud.

Skills

Spark

PySpark

Python

Java

Scala

Databricks

Azure Databricks

Job description

Nicoll Curtin is seeking an experienced Senior Data Engineer to join a finance transformation team in Switzerland. You will build a new data processing engine atop Spark, primarily using Python, with optional Java/Scala if needed.

The role focuses on true software development, not just ETL, and may require relocation to Switzerland. The project targets cloud-based, Azure Databricks-based data processing and integration services within a regulated financial services environment.