ETL Developer

CSK Nexus; City of Melbourne; Hybrid; AUD 90,000 - 130,000; Full time

Job summary

CSK Nexus is seeking a data engineer to design, build and optimise ETL pipelines and data models that support operational reporting, analytics and Tableau visuals.

You will work with SQL (Redshift, SQL Server, PostgreSQL) and Python, delivering robust data flows with near real-time and batch processing while collaborating with business stakeholders in a hybrid Melbourne-based setup.

Qualifications

• Minimum of 3 years' working experience in the data & analytics domain.
• Proven experience with ETL technologies such as Matillion, AWS Glue/Data Pipeline, SSIS.
• Extensive experience with Python (3+ years) for automation and integration.
• Demonstrated working knowledge of Redshift, SQL Server or PostgreSQL.
• Strong data modelling and documentation skills.

Responsibilities

• Design, build and test data transformation jobs, including modelling of very large data sets.
• Design, engineer and support ETL loading patterns (near real time, batch, historical, incremental).
• Write complex SQL queries to manage, manipulate and automate data feeds.
• Develop Python scripts to manage ETL jobs and orchestration.
• Identify efficiencies and optimise data transformation using best practices.
• Create comprehensive design and technical documentation.
• Collaborate with stakeholders to translate business needs into technical specs.
• Evaluate ETL requirements for completeness, accuracy and feasibility.
• Ensure data quality and end-to-end pipeline reliability before release.
• Estimate project timeframes and contribute to ETL framework design.
• Integrate AI and automation to enhance data validation and pipeline efficiency.

Skills

SQL queries

Python

ETL development

Data modelling

Documentation

Stakeholder communication

Education

Tertiary IT related qualification

Post-grad in Computer Science (Desirable)

Tools

Matillion

AWS Glue/Data Pipeline

SSIS

Job description

About the role

This role will involve development of data pipelines and data models to support the integration of new and existing data source systems used in business critical processes including operational reporting, analytics and support of Tableau data visualisation/reports.

Expert SQL skills with Redshift and Python capabilities who can cope and work in a fast-moving outcome-based delivery environment. Client is following a hybrid working model.

Typical Responsibilities

• Design, build and test data transformation jobs, including modelling of very large data sets.
• Design, engineer and support various ETL data loading patterns such as near real time, batch, historical and incremental.
• Write complex SQL queries to manage, manipulate and automate complex data feeds.
• Develop Python scripts to manage ETL jobs and orchestrate job schedules for near real time and batch
• Identify and implement efficiencies and optimisation of data transformation using industry best practice methods and tools.
• Exceptional documentation authoring skills of business and technical documents including but not limited to Design specifications, Technical specifications, Requirements and Test documents.
• Collaborate and work with Stakeholders to understand business requirements and translate into technical specifications.
• Evaluate ETL requirements for completeness, accuracy, and feasibility.
• Ensure product assurance across all ETL processes by validating data accuracy, completeness, transformations, and end‑to‑end pipeline reliability before release to downstream systems.
• Conduct analysis to estimate project timeframes for deliverables.
• Contribute to the design and implementation of the ETL framework and data model.
• Ability to gather requirements but suggest alternative better solutions to stakeholders and end users.
• Integrate AI and automation into ETL workflows to enhance data validation, anomaly detection, pipeline optimisation, and operational efficiency.
• Distil complex information and be able to communicate simply and in language that non technical staff understand.

Skills and experience required

• Minimum of 3 years' working experience in the data & analytics domain
• Strong experience with ETL technologies such as Matillion, AWS Glue/Data Pipeline, SSIS or similar with a flair for building complex SQL queries
• Extensive experience with Python (preferably 3+ years) for automation and integration
• Demonstrated working knowledge of databases such as Redshift, SQL Server or PostgreSQL
• Good understanding of RDBMS principles, database design, and query optimisation
• Experience documenting ETL processes and data models (e.g. entity relationship diagrams)
• Strong data modelling skills with the ability to transform staged data into conformed models and BI Datasets
• Knowledge of the utility industry highly desirable
• Strong analytical and interpretative skills
• Tertiary qualification in an IT related discipline

Desirable

• Post-grad qualification in Computer Science or similar
• Experience working with SAP CRM or Billing