Data Engineer: Scalable Pipelines on AWS/Snowflake (Remote)

LiveHire Limited; City of Melbourne; Hybrid; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Flybuysflex

Well-being days

Volunteer leave

Learning programs

Team discount

Be Well program

All-team events

Hybrid social events

Starter kit

Job summary

Flybuys in Melbourne is seeking a Data Engineer on a 24 month full-time fixed-term contract. You will design, build and maintain data pipelines, data assets and platforms to deliver trusted insights and scalable data products for partners and members.

Collaborating with product managers, analysts and tech teams, you’ll ensure data solutions are reliable, secure and governed, enabling analytics, reporting and personalised campaigns.

Qualifications

• Tertiary qualification in Information Technology and/or Computer Science, or equivalent experience.
• 3+ years of ETL/ELT with data modelling and BI or data warehousing knowledge.
• Experience with Snowflake, Oracle and Postgres is an advantage.
• Working knowledge of AWS cloud services.
• Hands-on SQL, Java, R, Python, Bash or similar scripting languages.
• Power BI experience is a plus.
• Agile, fast-paced environment with cross-functional collaboration.
• Experience with ML/AI analytics collaboration is a plus.

Responsibilities

• Expand and optimise data pipeline architecture for cross-functional teams.
• Develop and maintain scalable data pipelines and API integrations.
• Improve data models for BI tools and data accessibility for decision-making.
• Monitor data quality, security and availability for key stakeholders.
• Write unit/integration tests and contribute to technical docs.
• Build pipelines using Snowflake on AWS stack for diverse sources.
• Maintain data management systems and data quality frameworks.
• Develop repeatable data mining and modelling processes.
• Assemble large, complex data sets meeting requirements.
• Keep partner data secure within Snowflake databases and shares.
• Collaborate with architects, engineers and delivery teams to meet goals.
• Identify and implement internal process improvements for scalability.
• Work with analytics teams to enhance data system functionality.
• Innovate data pipeline design and delivery with colleagues.
• Ensure applications meet quality standards.
• Write clean, sustainable code for future reuse.
• Shape long-term data platform architecture with business units.
• Ensure solutions meet business and industry practices.
• Integrate new data tech into existing structures where appropriate.
• Recommend enhancements to data management systems.
• Stay up to date with data management best practices.
• Create training materials and development best practices docs.

Skills

ETL/ELT

Data modelling

SQL

Java

R

Python

Bash

Power BI

Agile

Cross-functional

Education

Bachelor's degree in IT/CS

Tools

Snowflake

Oracle

PostgreSQL

AWS

Job description

Flybuys in Melbourne is seeking a Data Engineer on a 24 month full-time fixed-term contract. You will design, build and maintain data pipelines, data assets and platforms to deliver trusted insights and scalable data products for partners and members.

Collaborating with product managers, analysts and tech teams, you’ll ensure data solutions are reliable, secure and governed, enabling analytics, reporting and personalised campaigns.