Data Engineer (Databricks & Fabric) - Remote

Diacto Technologies Pvt. Ltd.

Australia

Remote

AUD 120,000 - 150,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

CandidHR in Australia seeks a data engineer expert in Databricks and Fabric for a fully remote role. You will design, build and maintain scalable data pipelines and data solutions that drive business insights and decision-making, working closely with data scientists and analysts.

The role emphasizes data quality, performance optimization at scale, and documentation of processes. You will mentor junior engineers and collaborate across cloud platforms such as Azure and AWS in a distributed team.

Qualifications

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • 5+ years in data engineering focusing on Databricks and Fabric.
  • Strong SQL, Python, and Spark skills.
  • Experience with data modeling and ETL best practices.
  • Familiarity with cloud data platforms (Azure, AWS).
  • Ability to work independently and in a remote team.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using Databricks and Fabric.
  • Implement data transformations to ensure data quality and integrity.
  • Collaborate with data scientists and analysts to understand data needs and deliver reliable data solutions.
  • Optimize data storage and processing performance for large datasets.
  • Monitor and troubleshoot data pipeline performance ensuring minimal downtime.
  • Document data engineering processes and best practices.
  • Mentor junior data engineers and promote knowledge sharing within the team.

Skills

Databricks
Fabric
SQL
Python
Spark
Data modeling
ETL
Azure
AWS
Remote teamwork

Education

Bachelor's degree
Master's degree (preferred)

Tools

Databricks
Fabric

Job description

Job Description
About the Role

We are seeking a highly skilled and experienced Data Engineer specializing in Databricks and Fabric to join our dynamic team. In this remote position, you will play a pivotal role in designing and implementing robust data pipelines and data solutions that drive business insights and decision-making. Your expertise will help us leverage Databricks and Fabric to enhance our data processing capabilities, ensuring scalability and performance. If you are passionate about data engineering and are looking to make a significant impact.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using Databricks and Fabric.
  • Implement data transformation processes that ensure data quality and integrity.
  • Collaborate with data scientists and analysts to understand data needs and deliver reliable data solutions.
  • Optimize data storage and processing performance for large datasets.
  • Monitor and troubleshoot data pipeline performance issues, ensuring minimal downtime.
  • Documentation of data engineering processes and best practices.
  • Mentor junior data engineers and promote knowledge sharing within the team.
Required Qualifications
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience in data engineering, with a focus on Databricks and Fabric.
  • Strong proficiency in SQL, Python, and Spark.
  • Experience with data modeling and ETL best practices.
  • Familiarity with cloud data platforms (e.g., Azure, AWS).
  • Ability to work independently and collaboratively in a remote team environment.
Preferred Qualifications
  • Master's degree in a relevant field.
  • Experience with real-time data processing frameworks.
  • Knowledge of data governance and compliance standards.
  • Familiarity with Machine Learning concepts and tools.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - Databricks & Fabric (Remote)
Senior Data Engineer - Databricks & Fabric (Remote)

Diacto Technologies Pvt. Ltd. • Australia

Remote
AUD 120,000 - 150,000
Senior Data Engineer
Senior Data Engineer

Coforge Limited • Brisbane

On-site
AUD 140,000 - 190,000
Data Engineer | Databricks
Data Engineer | Databricks

Mane Consulting • Melbourne

On-site
AUD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

DX1 • Melbourne

On-site
AUD 160,000 - 230,000
Senior Data Engineer
Senior Data Engineer

Leaders • Western Australia

On-site
AUD 120,000 - 180,000
Health insurance
Data Engineer
Data Engineer

XPT Software • Sydney

On-site
AUD 140,000 - 190,000
Data Engineer
Data Engineer

Sirius. • Melbourne

Hybrid
AUD 140,000 - 180,000
Hybrid working model
Professional development budget
Data Engineer MS Fabrics
Data Engineer MS Fabrics

The HR Ally • Sydney

On-site
AUD 140,000 - 190,000
Sr. Forward Deployed Engineer
Sr. Forward Deployed Engineer

Databricks • Sydney

On-site
AUD 150,000 - 210,000
Data Engineer
Data Engineer

Data#3 • Sydney

On-site
AUD 90,000 - 120,000
Top locations