Data Engineer

Ben Rasa'S Demo Org; City of Melbourne; On-site; AUD 100,000 - 140,000; Full time

Job summary

The Melbourne-based Data Engineer will design, build, and maintain robust data pipelines and architectures to enable data-driven decision-making and improve operational efficiency in the automotive sector.

Responsibilities include scalable pipeline design, collaborating with data scientists and analysts, ensuring data quality, monitoring performance, documenting architectures, and staying current with industry trends. The role is based in Melbourne and is a permanent, full-time position.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 3–5 years data engineering experience.
• Proficiency in Python, Java, or Scala.
• Experience with data warehousing & ETL.
• Cloud platforms (AWS/Azure) and big data tech (Hadoop, Spark).
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.

Responsibilities

• Design and implement scalable data pipelines to support data ingestion and processing.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
• Ensure data quality and integrity through testing and validation processes.
• Monitor and optimise data systems for performance and reliability.
• Document data architecture and processes to ensure clarity and compliance.
• Stay updated with industry trends and technologies to improve data engineering practices.

Skills

Analytical thinking

Communication

Teamwork

Problem-solving

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Python

Java

Scala

AWS

Azure

Hadoop

Spark

ETL processes

Job description

Summary:

We are seeking a skilled Data Engineer to join our dynamic team in the automotive industry. This permanent, full-time role based in Melbourne, Victoria, will focus on designing, building, and maintaining robust data pipelines and architectures. The successful candidate will play a crucial role in enabling data-driven decision-making and enhancing our operational efficiency.

Responsibilities:

• Design and implement scalable data pipelines to support data ingestion and processing.


• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.


• Ensure data quality and integrity through rigorous testing and validation processes.


• Monitor and optimise data systems for performance and reliability.


• Document data architecture and processes to ensure clarity and compliance.


• Stay updated with industry trends and technologies to continuously improve data engineering practices.

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field.


• 3-5 years of experience in data engineering or a similar role.


• Proficiency in programming languages such as Python, Java, or Scala.


• Experience with data warehousing solutions and ETL processes.


• Familiarity with cloud platforms (e.g., AWS, Azure) and big data technologies (e.g., Hadoop, Spark).


• Strong analytical and problem-solving skills.


• Excellent communication and teamwork abilities.