Senior Data Engineer: Databricks, PySpark & APIs

SCOR Group; Rotterdam; Hybrid; EUR 90,000 - 130,000; Full time

Job summary

SCOR Group in Rotterdam, Netherlands, is seeking a Senior Data Engineer to join the APEX engineering team and help design and evolve our next-generation data platform.

You will build scalable data pipelines on Databricks using PySpark and Python, and collaborate with Backend Engineering to integrate data services with a Java-based ecosystem via APIs and microservices. The role emphasizes reliability, observability, and data quality.

Qualifications

• 7+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in Databricks, Spark/PySpark, Python, and SQL.
• Experience designing enterprise data pipelines and data models.
• Strong knowledge of Delta Lake, data governance, and data quality.
• Experience integrating data platforms with Java/Spring Boot apps and REST APIs.
• CI/CD practices and Git versioning experience.
• Excellent communication and stakeholder management skills.

Responsibilities

• Design, develop, and maintain enterprise-grade data pipelines.
• Build ETL/ELT processes for large-scale data ingestion and delivery.
• Optimize Delta Lake data models and storage structures.
• Implement data quality controls and monitoring solutions.
• Collaborate with backend teams to ensure end-to-end data flows.
• Contribute to CI/CD and deployment automation.
• Participate in architecture reviews and tech design discussions.
• Promote AI tools usage to improve efficiency in Databricks.

Skills

Databricks

Apache Spark / PySpark

Python

SQL

Data Modeling

Data Quality

Data Governance

Metadata Management

REST APIs

Microservices

Java/Spring Boot integration

Git

CI/CD

Tools

Delta Lake

Java/Spring Boot

REST APIs

CI/CD tooling

Job description

SCOR Group in Rotterdam, Netherlands, is seeking a Senior Data Engineer to join the APEX engineering team and help design and evolve our next-generation data platform.

You will build scalable data pipelines on Databricks using PySpark and Python, and collaborate with Backend Engineering to integrate data services with a Java-based ecosystem via APIs and microservices. The role emphasizes reliability, observability, and data quality.