Senior Data Engineer

Optiver Private Jobs; Amsterdam; On-site; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Performance-based bonus structure

Colleagues from 50+ countries

25 paid vacation days (first year)

Training opportunities

Health insurance discounts and fully‑s

Commuting expenses covered

Office perks: meals, coffee, physio,席

Job summary

Optiver Amsterdam is seeking an experienced Data Engineer to design and build production data pipelines and semantic models on Databricks. You’ll collaborate with Finance, People, Procurement and Compliance to deliver governed data assets that power analytics and AI agents.

You’ll work on governance, metadata, CI/CD, and data quality, shaping a scalable data platform in a fast-paced trading environment.

Qualifications

• 8+ years of experience designing and building production data pipelines and analytics solutions.
• Advanced SQL skills with hands-on dbt and PySpark; strong data modelling judgment.
• Hands-on Databricks experience including Delta Lake, Unity Catalog, PySpark-based development.
• Strong understanding of data modelling, data quality, and trusted data products.
• Experience implementing governance practices including access controls, lineage, and CI/CD.

Responsibilities

• Design, build, and optimise data pipelines, models, and data products using Databricks, dbt, SQL, and PySpark.
• Build and maintain semantic models powering reporting, self-service analytics, and Databricks Genie.
• Implement governance capabilities using Unity Catalog across domains.
• Contribute to DataHub adoption via metadata management and lineage capture.
• Partner with stakeholders to translate requirements into production data solutions.
• Drive engineering best practices through testing, CI/CD, documentation, reviews, and observability.
• Collaborate with leads to improve data architecture and delivery practices.

Skills

Advanced SQL

dbt

PySpark

Data modeling

Data governance

Stakeholder collaboration

Testing/CI/CD

Tools

Databricks

Delta Lake

Unity Catalog

DataHub

Job description

Every major business function, including Finance, People, Procurement, Tax, and Compliance, operates on its own version of the truth: fragmented, siloed, and manually managed. You’ll build the governed data foundation that replaces this, greenfield, on a modern stack, with real architectural ownership and production delivery in your hands.

The Problem You’re Solving

One truth across multiple domains. Multiple business functions. Multiple definitions of the same metrics. Your role is designing and building the unified semantic layer that brings this together. This is a real modelling challenge where getting the business logic right matters as much as getting the code right.

Governance that’s engineered, not bolted on. Lineage, access control, column masking, PII classification, and data stewardship are designed into every domain from day one using Unity Catalog and DataHub. The goal is a governance model rigorous enough to hold up to regulatory scrutiny and trusted enough that business teams stop building their own extracts.

The data layer that AI depends on. Optiver is building conversational analytics and AI agents that query business data through a semantic layer. What Databricks Genie surfaces to the business depends entirely on what you build underneath it.

What You’ll Do

• Design, build, and optimise data pipelines, models, and data products using Databricks, dbt, SQL, and PySpark, transforming fragmented business data into trusted and reusable assets

• Build and maintain semantic models that power reporting, self-service analytics, conversational analytics, and Databricks Genie

• Implement governance capabilities using Unity Catalog, including lineage, access controls, data classification, and data quality standards across every domain you deliver

• Contribute to DataHub adoption through metadata management, lineage capture, and data ownership standards that improve discoverability and trust

• Partner with business stakeholders to understand requirements and translate them into production-grade data solutions

• Drive engineering best practices through testing, CI/CD, documentation, code reviews, and observability

• Collaborate with technical leads to continuously improve data architecture, engineering standards, and delivery practices

Who You Are

• 8+ years of experience designing and building production data pipelines, data models, and analytical data solutions

• Advanced SQL skills with strong hands‑on experience using dbt, PySpark, or both. You build scalable data solutions, write tests as standard practice, and have strong data modelling judgement

• Hands‑on experience with Databricks, including Delta Lake, Unity Catalog, and PySpark‑based development

• Strong understanding of data modelling, data quality, and building trusted business‑facing data products

• Experience implementing governance practices, including access controls, lineage, testing, and CI/CD within modern data engineering environments

• Experience working with Finance, People/HR, Procurement, Operations, or similar business data domains is advantageous

• Strong communication skills and the ability to work directly with stakeholders to solve business problems through data

Why This Is Challenging

You’ll join a team building the foundations of how Optiver understands and operates its business. The data products you build will be used by business teams, leadership, and increasingly by AI‑powered tools and conversational analytics experiences.

You’ll work across a broad range of domains, from People and Finance to Procurement and Compliance, gaining exposure to how a global trading firm operates while building solutions on a modern stack that includes Databricks, dbt, Unity Catalog, DataHub, and Databricks Genie.

No prior trading or financial experience is needed – our onboarding program will kick‑start your career at Optiver and support you in gaining all the relevant knowledge about our business.

Who we are
At Optiver, our mission is to constantly improve the market by injecting liquidity, providing accurate pricing, increasing transparency and acting as a stabilizing force no matter the market conditions. With a focus on continuous improvement, we participate in the safeguarding of healthy and efficient markets for everyone who participates. As one of the largest market making institutions, we are a trusted partner of 70+ exchanges across the globe.

What you’ll get
You’ll join a culture of collaboration and excellence, where you’ll be surrounded by curious thinkers and creative problem solvers. Motivated by a passion for continuous improvement, you’ll thrive in a supportive, high‑performing environment alongside talented colleagues, working collectively to tackle the toughest problems in the financial markets.

In addition, you’ll receive:

• A performance‑based bonus structure, enabling all of our employees to benefit from our global profit pool.
• The opportunity to work alongside best‑in‑class professionals from over 50 different countries.
• 25 paid vacation days in your first year, increasing to 30 from your second year onwards.
• Training opportunities, discounts on health insurance, and fully paid first‑class commuting expenses.
• Extensive office perks, including breakfast, lunch and dinner, world‑class barista coffee, in‑house physio and chair massages, organized sports and leisure activities, and Friday afternoon drinks.
• Training and continuous learning opportunities, including access to conferences and tech events.

Diversity statement
Optiver is committed to diversity and inclusion.