Senior Data Engineer

Nicoll Curtin; Zürich; On-site; CHF 120,000 - 180,000; Full time

Job summary

Nicoll Curtin is seeking an experienced Senior Data Engineer to join a finance transformation team in Switzerland. You will build a new data processing engine atop Spark, primarily using Python, with optional Java/Scala if needed.

The role focuses on true software development, not just ETL, and may require relocation to Switzerland. The project targets cloud-based, Azure Databricks-based data processing and integration services within a regulated financial services environment.

Qualifications

• Experience with Spark or PySpark in a hands-on software engineering role.
• Strong Python background, with willingness to work in Python rather than JVM only.
• Experience with Databricks and cloud-based data platforms is a plus.

Responsibilities

• Contribute to a greenfield data processing engine on Spark within Azure Databricks.
• Develop software rather than pure ETL pipelines in a regulated industry context.
• Support a large-scale finance transformation migrating systems to the cloud.

Skills

Spark

PySpark

Python

Java

Scala

Databricks

Azure Databricks

Job description

Are you an experienced Data Engineer with an extensive background of true software engineering ideally within the financial services or other regulated industry? Do you have tangible hands on experience developing on Spark in either Python, Scala or Java? Are you interesting in developing a new data processing engine that is built on Databricks? If so this could be the perfect next Senior Data Engineer jobfor you.

The team have undertaken a large scale finance transformation program moving their finance and accounting systems to the cloud and developing the microservices integration services for it. They are now in the process of developing a greenfield data processing application built with Python, on Spark within Azure Databricks.

As such they are searching for an experienced Senior Data Engineer to join the team, who has experience of developing ACTUAL software, rather than purely ETL pipelines. What is essential is experience of using Spark or PySpark, Python experience is ideal however experience with JAVA or Scala is fine as long as you are willing to work in Python.

This is an urgent requirement however, given the challenge of finding the right profile, the team are willing to wait for candidates that have a notice period or are interested in relocating to Switzerland.