Data Products Solution Architect

Australian Prudential Regulation Authority; Sydney; On-site; AUD 180,000 - 250,000; Full time

Job summary

Australian Prudential Regulation Authority (APRA) seeks an experienced Data Products Solution Architect to shape APRA’s enterprise data platforms from Sydney CBD NSW. You will steer Azure Databricks initiatives, modernise legacy systems, and lead secure, scalable data solutions while guiding strategy to delivery across data, integration, analytics and AI.

You’ll collaborate with data engineering, enterprise architecture, cyber security and delivery teams to translate architecture into practical

Qualifications

• Experience with enterprise-scale Azure Databricks architecture and delivery.
• Strong knowledge of Unity Catalog, Delta Lake, Workflows, Databricks SQL, serverless compute and lakehouse architecture.
• Practical engineering and DataOps experience across Git, CI/CD, automated testing and observability.
• Strong data modelling and migration experience across legacy data warehouses and modern cloud data platforms.
• Experience designing secure, scalable and resilient enterprise solutions.

Responsibilities

• Lead solution architecture across APRA's data products and platforms, initially focusing on Azure Databricks.
• Define current, transition and target-state architectures and technology roadmaps.
• Lead Databricks architecture across platform design, governance, orchestration, security, resilience, observability, performance and cost.
• Develop solution designs and architecture decisions and guide solutions through governance.
• Define reusable data, integration, engineering and DataOps patterns, including CI/CD, automated testing and infrastructure as code.
• Lead architecture for data migration, coexistence and legacy platform decommissioning.
• Contribute to APRA's broader data products and AI roadmaps.
• Partner with delivery teams to translate architecture into practical implementation and support transition into business-as-usual.
• Provide technical leadership and design assurance to engineers, vendors and senior stakeholders.
• Clearly communicate technology options, risks, dependencies and trade-offs to technical and non-technical audiences.

Skills

Azure Databricks

Databricks SQL

Unity Catalog

Delta Lake

Data governance

CI/CD

Observability

Security

Stakeholder management

Power BI

MuleSoft

Tools

Power BI

MuleSoft

APIs

Job description

Australian Prudential Regulation Authority – Sydney CBD NSW

We are looking for an experienced Data Products Solution Architect to help shape the future of APRA's enterprise data platforms.

Initially, you'll play a key role in our data transformation, with a strong focus on Azure Databricks, modernising legacy platforms and establishing secure, scalable and sustainable data solutions. You'll bridge strategy and delivery, providing solution architecture leadership, design assurance and hands-on technical guidance.

Over time, your remit will broaden across APRA's data, integration, analytics, reporting and AI capabilities, giving you the opportunity to influence how we design and deliver data solutions across the organisation.

The team

You'll join our Technology Data Delivery team within APRA's Technology and Data division.

Working alongside data engineering, enterprise architecture, cyber security, infrastructure, testing and delivery teams, you'll help build, operate and evolve the platforms that underpin APRA's data capability.

This is a highly collaborative role where you'll work with engineers, senior stakeholders, vendors and delivery partners, providing technical leadership and helping turn complex architecture into practical, high-quality solutions.

Key responsibilities

• Lead solution architecture across APRA's data products and platforms, initially focusing on Azure Databricks
  
• Define current, transition and target-state architectures and technology roadmaps
  
• Lead Databricks architecture across platform design, governance, orchestration, security, resilience, observability, performance and cost
  
• Develop solution designs and architecture decisions and guide solutions through governance
  
• Define reusable data, integration, engineering and DataOps patterns, including CI/CD, automated testing and infrastructure as code
  
• Lead architecture for data migration, coexistence and legacy platform decommissioning
  
• Contribute to APRA's broader data products and AI roadmaps
  
• Partner with delivery teams to translate architecture into practical implementation and support transition into business-as-usual
  
• Provide technical leadership and design assurance to engineers, vendors and senior stakeholders
  
• Clearly communicate technology options, risks, dependencies and trade-offs to technical and non-technical audiences

About you

• Experienced solution or data architect who combines deep technical expertise with strong communication, stakeholder management and delivery skills.
  
• Extensive solution or data architecture experience, including enterprise-scale Azure Databricks architecture and delivery
  
• Strong knowledge of Unity Catalog, Delta Lake, Workflows, Databricks SQL, serverless compute and lakehouse architecture
  
• Practical engineering and DataOps experience across Git, CI/CD, automated testing and observability
  
• Strong data modelling and migration experience across legacy data warehouses and modern cloud data platforms
  
• Experience designing secure, scalable and resilient enterprise solutions
  
• An understanding of security, privacy, data governance, responsible AI and operational controls
  
• Experience across integration, APIs, analytics and reporting platforms
  
• Strong stakeholder management skills and the ability to influence senior stakeholders while working effectively with engineers and delivery teams
  
• The ability to balance strategic thinking with pragmatic, hands-on delivery
  
• Experience with Power BI, Posit, MuleSoft or regulatory data platforms will be highly regarded, along with relevant Azure or Databricks certifications.

  To work with us, you need to be an Australian citizen with eligibility to obtain and maintain Australian Government Security clearance.