Data Engineer — Scalable Pipelines & Cloud

Ben Rasa'S Demo Org; City of Melbourne; Sur place; AUD 100 000 - 140 000; Plein temps

Résumé du poste

The Melbourne-based Data Engineer will design, build, and maintain robust data pipelines and architectures to enable data-driven decision-making and improve operational efficiency in the automotive sector.

Responsibilities include scalable pipeline design, collaborating with data scientists and analysts, ensuring data quality, monitoring performance, documenting architectures, and staying current with industry trends. The role is based in Melbourne and is a permanent, full-time position.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 3–5 years data engineering experience.
• Proficiency in Python, Java, or Scala.
• Experience with data warehousing & ETL.
• Cloud platforms (AWS/Azure) and big data tech (Hadoop, Spark).
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.

Responsabilités

• Design and implement scalable data pipelines to support data ingestion and processing.
• Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
• Ensure data quality and integrity through testing and validation processes.
• Monitor and optimise data systems for performance and reliability.
• Document data architecture and processes to ensure clarity and compliance.
• Stay updated with industry trends and technologies to improve data engineering practices.

Connaissances

Analytical thinking

Communication

Teamwork

Problem-solving

Formation

Bachelor's degree in Computer Science, Engineering, or related field

Outils

Python

Java

Scala

AWS

Azure

Hadoop

Spark

ETL processes

Description du poste

The Melbourne-based Data Engineer will design, build, and maintain robust data pipelines and architectures to enable data-driven decision-making and improve operational efficiency in the automotive sector.

Responsibilities include scalable pipeline design, collaborating with data scientists and analysts, ensuring data quality, monitoring performance, documenting architectures, and staying current with industry trends. The role is based in Melbourne and is a permanent, full-time position.