Databricks Platform Lead - Data Engineering & Governance

Precision Sourcing; Sydney; On-site; AUD 150,000 - 210,000; Full time

Job summary

Precision Sourcing in Sydney is seeking a hands-on Data Platform Leader to implement a Databricks-based platform across governance, quality, and analytics for a regulated insurance environment. You will bridge engineering, architecture, governance, and delivery leadership, collaborating with actuarial, IT, security, and partners.

You will lead day-to-day technical coordination, drive pipelines, Unity Catalog, and performance tuning, and coach internal teams to reduce vendor reliance while

Qualifications

• 8+ years hands-on data engineering / platform engineering experience delivering production-grade solutions end-to-end.
• Strong Databricks / Spark delivery in production: pipeline build, orchestration, performance tuning, and operationalisation.
• Proven data governance implementation: RBAC, audit logging, lineage, data quality gates, and change control.
• Experience in a regulated or high-sensitivity data environment with strong security discipline.
• Demonstrated ability to lead co-delivery with vendors: set acceptance criteria, review designs and code, manage technical debt.
• Expert SQL and strong Python (including PySpark); strong software engineering discipline including Git, PR/code review, and CI/CD.

Responsibilities

• Lead day-to-day technical coordination across actuarial, business, IT, and vendor stakeholders.
• Contribute directly to Databricks implementation: pipelines, notebooks, Unity Catalog, orchestration, and performance optimisation.
• Support migration of priority data assets, processing logic, and analytics code into Databricks.
• Establish reusable patterns that support maintainability, governance, auditability, and performance.
• Implement governance practices: version control, code review, CI/CD, access control, data quality checks, and documentation standards.
• Define and enforce standards for open source, libraries, and third-party components including security and licensing compliance.
• Review and assure key technical artefacts from the implementation partner; manage technical debt and BAU readiness.
• Build internal capability through coaching, paired delivery, and knowledge transfer to reduce reliance on external vendors.

Skills

Databricks / Spark

SQL

Python (PySpark)

Git

CI/CD

Data governance

Tools

Unity Catalog

Airflow

Job description

Precision Sourcing in Sydney is seeking a hands-on Data Platform Leader to implement a Databricks-based platform across governance, quality, and analytics for a regulated insurance environment. You will bridge engineering, architecture, governance, and delivery leadership, collaborating with actuarial, IT, security, and partners.

You will lead day-to-day technical coordination, drive pipelines, Unity Catalog, and performance tuning, and coach internal teams to reduce vendor reliance while