Lead Data Engineer – Lakehouse for Real-Time Trading

Optiver

Amsterdam

On-site

EUR 90,000 - 140,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Breakfast

Lunch and Dinner

Barista Coffee

Physio & Chair Massages

Sports & Leisure Activities

Friday Drinks

Conferences & Training

Relocation Support

Visa Sponsorship

Paid Vacation 25–30 Days

Job summary

Optiver is seeking a seasoned Lead Data Engineer to advance our Lakehouse architecture and data capabilities for the Amsterdam-based research team. You will translate experimental research workflows into scalable, production-grade systems using Databricks, Apache Spark, and Delta Lake.

As a lead contributor in Amsterdam, you will influence local data strategy while collaborating with Global Research and Data Platform teams.

Qualifications

Extensive experience designing and building ETL/ELT pipelines.
Experience delivering production-grade data pipelines and platforms.
Ability to mentor engineers and promote DataOps practices.

Responsibilities

Design, build, and maintain reliable ETL/ELT pipelines using Spark, Structured Streaming, Databricks, and our in-house high-performance tools
Optimize and productionize research workflows with a strong focus on scalability, resilience, and performance tuning
Collaborate with power users to develop and share reusable patterns, templates, and onboarding pathways
Define, document, and enforce data engineering best practices
Mentor junior engineers and drive a culture of continuous learning and DataOps excellence