Databricks Data Platform Engineer — Pipelines & Governance

Precision Sourcing; Sydney; On-site; AUD 120,000 - 180,000; Full time

Job summary

Precision Sourcing is seeking a hands-on Databricks Engineer to contribute to our Data & Analytics platform. You will build and operationalise Databricks pipelines, notebooks, and Unity Catalog configurations while collaborating with actuarial, IT, security and governance teams.

In a regulated, high-sensitivity environment, you will apply governance practices, optimise performance, and support migration of analytics code. Australian citizens living in Sydney only need apply.

Qualifications

• Solid Databricks / Spark delivery in production: pipeline build, orchestration, performance tuning, and operationalisation.
• Exposure to data governance practices: RBAC, audit logging, lineage, data quality gates, and change control.
• Experience working in a regulated or high-sensitivity data environment with strong security discipline.
• Ability to collaborate effectively in co-delivery models with vendors and internal teams.
• Strong SQL and Python (including PySpark); solid software engineering discipline including Git, PR/code review, and CI/CD.

Responsibilities

• Contribute to day-to-day technical delivery across actuarial, business, IT, and vendor stakeholders.
• Build and maintain Databricks pipelines, notebooks, Unity Catalog configurations, orchestration workflows, and performance optimisations.
• Support migration of priority data assets, processing logic, and analytics code into Databricks.
• Develop reusable patterns that support maintainability, governance, auditability, and performance.
• Apply governance practices: version control, code review, CI/CD, access control, data quality checks, and documentation standards.
• Adhere to and contribute to standards for open source, libraries, and third-party components including security and licensing compliance.
• Participate in technical reviews of key artefacts; support management of technical debt and BAU readiness.
• Contribute to knowledge sharing and capability building to reduce reliance on external vendors.

Skills

Databricks

Spark

SQL

Python

PySpark

Tools

Git

CI/CD

PR/code review

Job description

Precision Sourcing is seeking a hands-on Databricks Engineer to contribute to our Data & Analytics platform. You will build and operationalise Databricks pipelines, notebooks, and Unity Catalog configurations while collaborating with actuarial, IT, security and governance teams.

In a regulated, high-sensitivity environment, you will apply governance practices, optimise performance, and support migration of analytics code. Australian citizens living in Sydney only need apply.