Databricks Platform Engineer - Secure Cloud & Defense

Showtime Consulting Pty Ltd; Canberra; Hybrid; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Remote-friendly roles

Professional development support

Salary packages

Job summary

Showtime Consulting is seeking an experienced Databricks Application Engineer to join a Sydney-based team supporting modern data and application platform capabilities. This hands-on role will blend data engineering with software development to deliver scalable Databricks-based solutions.

You will design, develop, and maintain data pipelines, API integrations, and platform services, working closely with stakeholders to enable innovative business outcomes in enterprise environments.

Qualifications

• Experience across data engineering and software engineering.
• Hands-on experience with the Databricks native platform.
• Strong experience with Lakeflow Connect and Lakeflow Pipelines.
• Experience building data ingestion, transformation, and orchestration frameworks.
• Strong Python and SQL development skills.
• Solid understanding of modern web application architecture.
• Experience designing, developing, and integrating REST APIs.
• Strong understanding of API security, authentication, and authorisation concepts.
• Experience working across the full software development lifecycle.
• Familiarity with CI/CD practices and DevOps methodologies.
• Strong analytical, troubleshooting, and problem-solving skills.
• Ability to work collaboratively with business and technology stakeholders.

Responsibilities

• Design, build, and maintain scalable data pipelines using the Databricks platform.
• Develop and support data ingestion, transformation, and orchestration frameworks.
• Build and manage solutions using Lakeflow Connect and Lakeflow Pipelines.
• Develop scalable data processing solutions using Python and SQL.
• Ensure data quality, reliability, and performance across batch and near real-time workloads.
• Collaborate with architecture and platform teams to implement data governance and best practices.
• Design and develop modern web-based applications integrated with Databricks platforms.
• Build and consume REST APIs to support application and platform integrations.
• Implement secure API authentication and authorisation mechanisms.
• Contribute to application design, development, testing, deployment, and support activities.
• Support CI/CD pipelines and promote DevOps best practices across projects.
• Develop scalable and maintainable solutions aligned to enterprise architecture standards.
• Work closely with business stakeholders to translate requirements into technical solutions.
• Troubleshoot and resolve complex technical issues across data, platform, and application layers.

Skills

Databricks platform

Lakeflow Connect

Lakeflow Pipelines

Python

SQL

REST APIs

API security

CI/CD

DevOps

Agile delivery

Cloud-native

Tools

Databricks

Lakeflow

Job description

Showtime Consulting is seeking an experienced Databricks Application Engineer to join a Sydney-based team supporting modern data and application platform capabilities. This hands-on role will blend data engineering with software development to deliver scalable Databricks-based solutions.

You will design, develop, and maintain data pipelines, API integrations, and platform services, working closely with stakeholders to enable innovative business outcomes in enterprise environments.