Lead Data Engineer

Randstad Digital Australia; Canberra; On-site; AUD 166,000 - 221,000; Full time

Job summary

Randstad Digital in Canberra is seeking a Data Pipeline Engineer with 5+ years’ experience in cloud environments to design, build, and deploy robust data pipelines. You will work with AWS Glue, Terraform, and Kinesis to manage storage, processing, and security across data streams.

The role requires strong communication, Agile practices, and hands-on ETL tool experience. This contract is 12 months with extension, Canberra-based with some flexibility.

Qualifications

• Minimum five years' experience as a Data Pipeline Engineer in a Cloud Computing environment.
• Experience configuring data pipelines (design, build, test, deploy) across formats such as MFT, API, and file extracts.
• Strong command of AWS data services for storage, extraction, transformation, and processing.
• Experience with Agile development methodologies (Scrum, Kanban, Lean, XP).

Responsibilities

• Hands-on expertise in scripting languages (e.g., AWS Glue, HashiCorp Terraform).
• Solid understanding of cloud-based architecture related to data storage and pipelines.
• Understand and create data processing streams (e.g., AWS Kinesis).
• Implement security and access controls around data pipelines.
• High level of communication skills for technical and business discussions.
• Experience with Agile development methodologies.
• Experience with data pipeline ETL tools (AWS Glue, Informatica, DBT, Talend).

Skills

Data Pipeline Engineer

Agile methodologies

Cloud Computing

Security concepts

Communication skills

Tools

AWS Glue

HashiCorp Terraform

AWS Kinesis

Informatica

DBT

Talend

Job description

• 12 month contract with 12 month extension


• 12 month contract with 12 month extension


• Canberra based, other states can be considered


• Must be able to NV1 security clearance


• 12 month contract with 12 month extension


• Canberra based, other states can be considered


• Australian Citizens


• Must be able to NV1 security clearance

Randstad Digital (Formerly Finite Recruitment)

Randstad Digital was announced on August 30, 2023, under the umbrella of Randstad, the world's largest talent company and a partner of choice to clients. Our 46,000 employees around the world make a positive impact on society by helping people to realize their true potential throughout their working life. In 2022, in our 39 markets, we helped more than 2 million people find a job that feels good and advised over 230,000 clients on their talent needs.

Responsibilities

• have hands on technical expertise in scripting languages (e.g. AWS Glue, HashiCorp Terraform)


• have a solid and practical understanding of cloud-based architecture relating to data storage and pipelines


• understand and work to create data processing streams (e.g. AWS Kinesis)


• understand and be able to implement security and access controls around data pipelines


• have high level of communication skills, demonstrating an ability to communicate at the technical and business levels.


• have experience in Agile development methodologies


• have experience in data pipeline ETL tools (e.g. AWS Glue, Informatica, DBT, Talend etc)

Skills required

• Minimum of five years' experience working as a Data Pipeline Engineer in a Cloud Computing environment.


• Experience configuring (design, build, test, deploy) varying types of data pipelines solutions e.g. MFT, API, File extracts etc.


• Good command of Amazon Web Services as it relates to Data Storage, Extraction, Transformation, Data processing frameworks, and a proficient understanding of security concepts around these.


• Experience with Agile development methodologies (Scrum, Kanban, Lean, Xtreme Programming).

At Randstad, we are passionate about providing equal employment opportunities and embracing diversity to the benefit of all. We actively encourage applications from any background.