Principal Data Engineer

Optiver

Sydney

Vor Ort

AUD 150.000 - 200.000

Vollzeit

14 Tage+

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Performance-based bonus structure
Daily breakfast and lunch
Gym membership
Social events and company trip every two years

Zusammenfassung

Optiver is looking for a senior data architect to build a governed data foundation across multiple business functions in Sydney, Australia. You will architect and own the delivery of shared data products while ensuring compliance with governance standards.

This role demands 12+ years of experience, expert SQL skills, and familiarity with Databricks and modern data architectures. Enjoy a performance-based bonus structure, diverse colleagues, and ample personal development opportunities.

Qualifikationen

  • 12+ years of experience designing and building production data solutions.
  • Track record of leading complex technical initiatives end-to-end.
  • Experience in designing end-to-end data solutions for scale.

Aufgaben

  • Architect and own delivery of shared data products across departments.
  • Build and evolve the semantic layer for reporting and analytics.
  • Design and build scalable data pipelines and models.

Kenntnisse

Architectural ownership
Expert-level SQL
Data transformation
Databricks experience
Governance implementation
Complex problem-solving

Tools

dbt
PySpark
Unity Catalog
DataHub

Jobbeschreibung

Every major business function, including Finance, People, Procurement, Tax, and Compliance, operates on its own version of the truth: fragmented, siloed, and manually managed. You'll build the governed data foundation that replaces this, greenfield, on a modern stack, with real architectural ownership and production delivery in your hands.

The Problem You’re Solving

One truth across multiple domains. Multiple business functions. Multiple definitions of the same metrics. Your role is designing and building the unified semantic layer that brings this together. This is a real modelling challenge where getting the business logic right matters as much as getting the code right.

Governance that’s engineered, not bolted on. Lineage, access control, column masking, PII classification, and data stewardship are designed into every domain from day one using Unity Catalog and DataHub. The goal is a governance model rigorous enough to hold up to regulatory scrutiny and trusted enough that business teams stop building their own extracts.

The data layer that AI depends on. Optiver is building conversational analytics and AI agents that query business data through a semantic layer. What Databricks Genie surfaces to the business depends entirely on what you build underneath it.

What You’ll Do
  • Architect and own delivery of shared data products across Finance, People, Procurement, and Compliance, from design decisions through to production
  • Build and evolve the semantic layer that powers reporting, self‑service analytics, conversational analytics, and Databricks Genie, writing the models, tests, and documentation that make it trustworthy
  • Design and build scalable data pipelines, data models, and governed data products using Databricks, dbt, SQL, and PySpark
  • Implement governance capabilities end‑to‑end, including Unity Catalog access controls, column‑level security, data classification, lineage, and data quality standards
  • Drive DataHub adoption by defining metadata standards, lineage definitions, and data ownership models that make discoverability a first‑class engineering concern
  • Translate complex and ambiguous requirements from senior stakeholders into production‑grade data solutions, owning the problem from conversation to deployed model
  • Set the engineering standard for the team through the quality of your code, architecture decisions, and pull request reviews
  • Partner with the broader data team to continuously improve CI/CD, testing frameworks, observability, and data quality practices
Who You Are
  • 12+ years of experience designing and building production data solutions, with a track record of leading complex technical initiatives end‑to‑end.
  • Track record of architectural ownership and designing end‑to‑end data solutions
  • Expert‑level SQL and data transformation skills, with strong hands‑on experience in dbt, PySpark, or both. You design data products for scale, write tests without friction, and have clear opinions on where each tool’s limits are.
  • Deep experience with Databricks, Lakehouse architectures, or comparable modern data technologies, including Delta table design, Unity Catalog governance, compute trade‑offs, and downstream BI or AI workloads
  • Experience implementing governance at scale, including access control, PII handling, column‑level security, data lineage, and data quality management in production environments
  • Experience building trusted business‑facing data products within Finance, People/HR, Procurement, Operations, or similar domains. You understand business logic well enough to challenge unclear or incorrect requirements.
Why This Is Challenging

You’ll join a team building the foundations of how Optiver understands and operates its business. The data products you build will be used by business teams, leadership, and increasingly by AI‑powered tools and conversational analytics experiences. You’ll work across a broad range of domains, from People and Finance to Procurement and Compliance, gaining exposure to how a global trading firm operates while building solutions on a modern stack that includes Databricks, dbt, Unity Catalog, DataHub, and Databricks Genie.

Who We Are

At Optiver, our mission is to constantly improve the market by injecting liquidity, providing accurate pricing, increasing transparency and acting as a stabilizing force no matter the market conditions. With a focus on continuous improvement, we participate in the safeguarding of healthy and efficient markets for everyone who participates. As one of the largest market‑making institutions, we are a trusted partner of 70+ exchanges across the globe.

What You’ll Get
  • A performance‑based bonus structure unmatched anywhere in the industry. We combine our profits across desks, teams and offices into a global profit pool, fostering a truly collaborative environment.
  • The chance to work alongside diverse and intelligent peers in a rewarding environment.
  • Training, mentorship and personal development opportunities.
  • Daily breakfast, lunch and an in‑house barista.
  • Gym membership plus weekly in‑house chair massages.
  • Regular social events, including a company trip every two years.
  • Guided relocation, a competitive relocation package and visa sponsorship where necessary.

Optiver is committed to diversity and inclusion. We encourage applications from candidates of all backgrounds, and welcome requests for reasonable adjustments during the process.

Questions? Get in touch with the recruitment team at careers@optiver.com.au

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior Data Engineer
Senior Data Engineer

Optiver • Sydney

Vor Ort
AUD 180.000 - 240.000
Performance-based bonus
Global team
Training & mentorship
+5
Senior Data Engineer — Semantic Layer & Governance
Senior Data Engineer — Semantic Layer & Governance

Optiver • Sydney

Vor Ort
AUD 180.000 - 240.000
Performance-based bonus
Global team
Training & mentorship
+5
Senior Data Architect — End-to-End Platform & Governance
Senior Data Architect — End-to-End Platform & Governance

Optiver • Sydney

Vor Ort
AUD 150.000 - 200.000
Performance-based bonus structure
Daily breakfast and lunch
Gym membership
+1
Data Engineer Aws - Real-Time Pipelines (Hybrid)
Data Engineer Aws - Real-Time Pipelines (Hybrid)

Asx • Sydney

Hybrid
AUD 140.000 - 190.000
Monthly Lifestyle Allowance: Health/wb
Novated Leasing: Pre-tax car leasing
Loyalty Leave: extra leave days
+2
Senior Data Engineer | Databricks
Senior Data Engineer | Databricks

Vivanti Consulting • Brisbane

Vor Ort
AUD 150.000 - 190.000
Mentoring Program
Paid Certifications
Hackathons
+3
Manager, Forward Deployed Engineering
Manager, Forward Deployed Engineering

FDE Times • Sydney

Hybrid
AUD 180.000 - 240.000
Saas Bdr For Data Infrastructure (Hybrid)
Saas Bdr For Data Infrastructure (Hybrid)

Fivetran, Inc. • Sydney

Hybrid
AUD 180.000 - 240.000
Flexible hybrid working
Global career pathways
Continuous learning opportunities
+2
Data Engineer
Data Engineer

Sirius. • Melbourne

Hybrid
AUD 140.000 - 180.000
Hybrid working model
Professional development budget
Solutions Architect – Data Intelligence & Cloud Analytics
Solutions Architect – Data Intelligence & Cloud Analytics

Databricks Inc. • Melbourne

Vor Ort
AUD 180.000 - 240.000
Data & Ai Solutions Architect
Data & Ai Solutions Architect

Neon • Melbourne

Vor Ort
AUD 120.000 - 180.000
Top-Standorte