Cloud Data Engineer: Scalable Pipelines & ML-Ready Data

Vericent Pty; Melbourne; On-site; AUD 120,000 - 160,000; Full time

Job summary

Vericent in Melbourne is seeking an experienced Data Engineer to design, build and optimise enterprise-scale data pipelines and cloud-based data solutions that enable analytics, reporting and AI-driven outcomes.

You will collaborate with data scientists, software engineers and business stakeholders to ensure data quality, security and performance across the data lifecycle, while contributing to CI/CD practices and production support.

Qualifications

• Advanced SQL skills and performance awareness for large data sets.
• Experience with data modelling, warehousing and analytical patterns.
• Experience implementing data-quality controls and reconciliation processes.
• Strong documentation and stakeholder communication.

Responsibilities

• Design, build and maintain batch and real-time data pipelines.
• Develop ingestion and transformation processes for structured and semi-structured data.
• Build datasets for reporting, analytics and ML.
• Develop solutions using SQL, Python, dbt, PySpark or equivalent technologies.
• Integrate data from enterprise applications and external sources.
• Optimize pipelines for reliability, performance and cost.
• Support migration and modernization of legacy data processes.

Skills

Advanced SQL

Data modelling

Data warehousing

Strong stakeholder communication

Technical documentation

Education

Tertiary qualification in computer science, engineering, information systems or related discipline

Tools

Snowflake

dbt

Databricks

PySpark

Git

CI/CD

Job description

Vericent in Melbourne is seeking an experienced Data Engineer to design, build and optimise enterprise-scale data pipelines and cloud-based data solutions that enable analytics, reporting and AI-driven outcomes.

You will collaborate with data scientists, software engineers and business stakeholders to ensure data quality, security and performance across the data lifecycle, while contributing to CI/CD practices and production support.