Databricks Platform Engineer: Data Pipelines & Apps

Showtime Consulting; Sydney; On-site; AUD 120,000 - 160,000; Full time

Job summary

Showtime Consulting in Sydney is seeking an experienced Databricks Application Engineer to join a local team supporting the development of modern data and application platform capabilities. You will design, develop, and maintain data pipelines and platform services that enable scalable, secure data solutions for enterprise customers.

You will work with business and technology stakeholders, implement REST APIs, and promote CI/CD and DevOps practices across projects, delivering reliable data

Qualifications

• Experience across data engineering and software engineering.
• Hands-on experience with the Databricks native platform.
• Strong Python and SQL development skills.
• Experience building data ingestion, transformation, and orchestration frameworks.
• Experience designing, developing, and integrating REST APIs.
• Familiarity with CI/CD practices and DevOps methodologies.

Responsibilities

• Design, build, and maintain scalable data pipelines using the Databricks platform.
• Develop and support data ingestion, transformation, and orchestration frameworks.
• Build and manage solutions using Lakeflow Connect and Lakeflow Pipelines.
• Develop scalable data processing solutions using Python and SQL.
• Ensure data quality, reliability, and performance across batch and near real-time workloads.
• Collaborate with architecture and platform teams to implement data governance and best practices.
• Design and develop modern web-based applications integrated with Databricks platforms.
• Build and consume REST APIs to support application and platform integrations.
• Implement secure API authentication and authorisation mechanisms.
• Contribute to application design, development, testing, deployment, and support activities.
• Support CI/CD pipelines and promote DevOps best practices across projects.
• Develop scalable and maintainable solutions aligned to enterprise architecture standards.
• Work closely with business stakeholders to translate requirements into technical solutions.
• Troubleshoot and resolve complex technical issues across data, platform, and application layers.

Skills

Data engineering

Software engineering

Python

SQL

REST APIs

CI/CD

DevOps

Agile

Stakeholder collaboration

Troubleshooting

Tools

Databricks platform

Lakeflow Connect

Lakeflow Pipelines

Job description

Showtime Consulting in Sydney is seeking an experienced Databricks Application Engineer to join a local team supporting the development of modern data and application platform capabilities. You will design, develop, and maintain data pipelines and platform services that enable scalable, secure data solutions for enterprise customers.

You will work with business and technology stakeholders, implement REST APIs, and promote CI/CD and DevOps practices across projects, delivering reliable data