Data Pipeline Engineer - Cloud/AWS | NV1 Clearance

Randstad Digital Australia; Canberra; On-site; AUD 166,000 - 221,000; Full time

Job summary

Randstad Digital in Canberra is seeking a Data Pipeline Engineer with 5+ years’ experience in cloud environments to design, build, and deploy robust data pipelines. You will work with AWS Glue, Terraform, and Kinesis to manage storage, processing, and security across data streams.

The role requires strong communication, Agile practices, and hands-on ETL tool experience. This contract is 12 months with extension, Canberra-based with some flexibility.

Qualifications

• Minimum five years' experience as a Data Pipeline Engineer in a Cloud Computing environment.
• Experience configuring data pipelines (design, build, test, deploy) across formats such as MFT, API, and file extracts.
• Strong command of AWS data services for storage, extraction, transformation, and processing.
• Experience with Agile development methodologies (Scrum, Kanban, Lean, XP).

Responsibilities

• Hands-on expertise in scripting languages (e.g., AWS Glue, HashiCorp Terraform).
• Solid understanding of cloud-based architecture related to data storage and pipelines.
• Understand and create data processing streams (e.g., AWS Kinesis).
• Implement security and access controls around data pipelines.
• High level of communication skills for technical and business discussions.
• Experience with Agile development methodologies.
• Experience with data pipeline ETL tools (AWS Glue, Informatica, DBT, Talend).

Skills

Data Pipeline Engineer

Agile methodologies

Cloud Computing

Security concepts

Communication skills

Tools

AWS Glue

HashiCorp Terraform

AWS Kinesis

Informatica

DBT

Talend

Job description

Randstad Digital in Canberra is seeking a Data Pipeline Engineer with 5+ years’ experience in cloud environments to design, build, and deploy robust data pipelines. You will work with AWS Glue, Terraform, and Kinesis to manage storage, processing, and security across data streams.

The role requires strong communication, Agile practices, and hands-on ETL tool experience. This contract is 12 months with extension, Canberra-based with some flexibility.