Senior Data Engineer - Semantic Layer & Governance

Optiver Private Jobs; Amsterdam; On-site; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Performance-based bonus structure

Colleagues from 50+ countries

25 paid vacation days (first year)

Training opportunities

Health insurance discounts and fully‑s

Commuting expenses covered

Office perks: meals, coffee, physio,席

Job summary

Optiver Amsterdam is seeking an experienced Data Engineer to design and build production data pipelines and semantic models on Databricks. You’ll collaborate with Finance, People, Procurement and Compliance to deliver governed data assets that power analytics and AI agents.

You’ll work on governance, metadata, CI/CD, and data quality, shaping a scalable data platform in a fast-paced trading environment.

Qualifications

• 8+ years of experience designing and building production data pipelines and analytics solutions.
• Advanced SQL skills with hands-on dbt and PySpark; strong data modelling judgment.
• Hands-on Databricks experience including Delta Lake, Unity Catalog, PySpark-based development.
• Strong understanding of data modelling, data quality, and trusted data products.
• Experience implementing governance practices including access controls, lineage, and CI/CD.

Responsibilities

• Design, build, and optimise data pipelines, models, and data products using Databricks, dbt, SQL, and PySpark.
• Build and maintain semantic models powering reporting, self-service analytics, and Databricks Genie.
• Implement governance capabilities using Unity Catalog across domains.
• Contribute to DataHub adoption via metadata management and lineage capture.
• Partner with stakeholders to translate requirements into production data solutions.
• Drive engineering best practices through testing, CI/CD, documentation, reviews, and observability.
• Collaborate with leads to improve data architecture and delivery practices.

Skills

Advanced SQL

dbt

PySpark

Data modeling

Data governance

Stakeholder collaboration

Testing/CI/CD

Tools

Databricks

Delta Lake

Unity Catalog

DataHub

Job description

Optiver Amsterdam is seeking an experienced Data Engineer to design and build production data pipelines and semantic models on Databricks. You’ll collaborate with Finance, People, Procurement and Compliance to deliver governed data assets that power analytics and AI agents.

You’ll work on governance, metadata, CI/CD, and data quality, shaping a scalable data platform in a fast-paced trading environment.