Databricks Application Engineer

CareCone Group; Sydney; On-site; AUD 120,000 - 160,000; Full time

Job summary

CareCone Group is seeking a Databricks Application Engineer in Sydney to design, build, and maintain scalable data pipelines and aplicações on the Databricks platform. The role emphasizes Python/SQL development, REST API integrations, and alignment with enterprise data governance and DevOps practices.

The ideal candidate will have extensive data and software engineering experience, hands-on Databricks expertise, and a proven ability to work with stakeholders across business and technology teams.

Qualifications

• Extensive years of experience in Data Engineering and Software Engineering.
• Hands-on experience with the Databricks Native Platform.

Responsibilities

• Design, build, and maintain data pipelines on Databricks platform.
• Develop scalable data processing solutions using Python and SQL.
• Build and consume REST APIs for application/platform integrations.
• Collaborate with architecture and platform teams on governance and best practices.
• Support CI/CD pipelines and promote DevOps across projects.

Skills

Databricks Native Platform

Python

SQL

Data Engineering

REST API

DevOps

CI/CD

Web Applications

Tools

Lakeflow Connect

Lakeflow Pipelines

Job description

Hiring for Databricks Application Engineer

Location- SYDNEY

Position- Permanent

5+ years of overall IT experience

Job Description:

We are seeking a skilled Data Engineer / Databricks Application Engineer to support our evolving technology roadmap as we transition from traditional data archival initiatives toward building modern platform capabilities and Databricks-based application solutions.

This role will play a key part in designing, developing, and maintaining scalable data and application platforms, enabling the delivery of innovative business solutions. The ideal candidate will have strong experience in Databricks, data engineering, software development, and enterprise integrations, with the ability to work closely with stakeholders across business and technology teams.

Key Responsibilities:

• Design, build, and maintain data pipelines using the Databricks native platform.
• Develop and support data ingestion, transformation, and orchestration frameworks.
• Build and manage solutions leveraging Lakeflow Connect and Lakeflow Pipelines.
• Develop scalable data processing solutions using Python and SQL.
• Ensure data quality, reliability, and performance across batch and near real-time workloads.
• Collaborate with architecture and platform teams to implement data governance and best practices.

Software Engineering

• Design and develop modern web-based applications integrated with Databricks platforms.
• Build and consume REST APIs to support application and platform integrations.
• Implement secure API authentication and authorization mechanisms.
• Participate in application design, development, testing, deployment, and support activities.
• Contribute to CI/CD pipelines and promote DevOps best practices across projects.

Platform & Integration

• Support enterprise integration requirements across multiple systems and platforms.
• Develop scalable, maintainable solutions aligned with enterprise architecture standards.
• Work closely with business stakeholders to understand requirements and translate them into technical solutions.
• Troubleshoot and resolve complex technical issues while ensuring high system availability and performance.

Required Skills & Experience:

• Extensive years of experience in Data Engineering and Software Engineering.
• Hands-on experience with the Databricks Native Platform

Strong experience with:

• Lakeflow Connect
• Lakeflow Pipelines
• Data ingestion, transformation, and orchestration frameworks
• Proficiency in Python and SQL.
• Solid understanding of modern web application architecture.
• Experience with REST API design, development, and integration.
• Strong knowledge of API security and authentication concepts.
• Experience working across the Software Development Lifecycle (SDLC).
• Familiarity with CI/CD practices and DevOps methodologies.
• Strong analytical, troubleshooting, and problem-solving skills

Note- Must have valid Australian work Authorization.