Senior Data Engineer — Semantic Layer & Governance

Optiver; Council of the City of Sydney; On-site; AUD 180,000 - 240,000; Full time

Benefits offered by this job

Performance-based bonus

Global team

Training & mentorship

Daily meals

Gym membership

Chair massages

Social events

Relocation & visa sponsorship

Job summary

Optiver is building a governed data foundation on a modern stack to unify metrics across Finance, People, Procurement, and Compliance. You’ll design a semantic layer and production-grade data products, empowering reporting, analytics, and AI experiences.

You’ll implement Unity Catalog governance, build scalable pipelines with Databricks and PySpark, and drive DataHub adoption to make data discovery a first-class engineering concern.

Qualifications

• 8+ years of experience designing and building production data solutions
• Architectural ownership of end-to-end data platforms
• Expert-level SQL and data transformation skills with dbt/PySpark
• Deep experience with Databricks, Lakehouse architectures, and governance tooling
• Experience implementing governance at scale (access control, PII handling, lineage, data quality)
• Ability to translate complex requirements into production-grade data solutions

Responsibilities

• Architect and own delivery of shared data products across Finance, People, Procurement, and Compliance, from design decisions through to production
• Build and evolve the semantic layer powering reporting, self-service analytics, and AI tools
• Design and build scalable data pipelines, data models, and governed data products using Databricks, dbt, SQL, and PySpark
• Implement governance end-to-end (Unity Catalog, access controls, data classification, lineage, quality)
• Drive DataHub adoption by defining metadata standards and lineage definitions
• Translate requirements from senior stakeholders into production-grade data solutions
• Set engineering standards through code quality, architecture decisions, and PR reviews
• Partner with data teams to improve CI/CD, testing, observability, and data quality practices

Skills

SQL

dbt

PySpark

Databricks

Data governance

Stakeholder communication

Tools

Databricks

Unity Catalog

DataHub

Delta lake

Job description

Optiver is building a governed data foundation on a modern stack to unify metrics across Finance, People, Procurement, and Compliance. You’ll design a semantic layer and production-grade data products, empowering reporting, analytics, and AI experiences.

You’ll implement Unity Catalog governance, build scalable pipelines with Databricks and PySpark, and drive DataHub adoption to make data discovery a first-class engineering concern.