Data Engineer

Himanshu Gupta; Brisbane, Gold Coast City; In loco; AUD 110.000 - 160.000; Tempo pieno

Descrizione del lavoro

Unknown company is seeking an experienced Data Engineer for a Gold Coast based role focused on a large-scale data platform transformation and Snowflake-centric architecture. The candidate will contribute to strategy and hands-on delivery, collaborating with vendors and internal teams to shape the data environment.

The role requires senior-level expertise in data ingestion, modelling, ETL/ELT development, and cloud data solutions with Snowflake at the core.

Competenze

• Strong experience delivering large-scale data platform / data transformation programs.
• Proven experience migrating legacy SQL databases into a modern Enterprise Data Warehouse (EDW) environment.
• Strong Snowflake experience, with Snowflake sitting at the centre of the target data architecture.
• Experience designing and/or delivering data ingestion pipelines.
• Experience with cloud-hosted data solutions, ideally across Azure or AWS.
• Comfortable working closely with third-party vendors/consultancies, internal stakeholders and technical teams.
• They need senior, hands-on people rather than junior resources.

Mansioni

• Build pipelines and data structures moving data from legacy to Snowflake.
• Extract data from legacy SQL databases.
• Design and build ingestion pipelines (ETL/ELT).
• Transform and load data into Snowflake and model EDW structures.
• Perform data quality checks and reconciliation.
• Coordinate with DBT, ADF, Databricks, Airflow or Snowflake-native tooling.

Conoscenze

Data platform delivery

SQL development

Data modelling

Data quality

ETL/ELT development

Performance optimisation

Pipeline orchestration

Strumenti

Snowflake

DBT

Azure Data Factory

Databricks

Airflow

Descrizione del lavoro

Data Engineer - Gold Coast based - Coolangatta

About the Role:

Project Description: Data Platform / Snowflake Transformation

The organisation is currently undertaking a large-scale data platform transformation, working alongside a third-party implementation/vendor partner. They are looking to bring in experienced contract resources to supplement the vendor team and internal capability, particularly around the technical strategy and delivery of the new data environment. The initial requirement is likely to be around four roles, although two are immediate priorities. They are looking for people who can start within the next 2-3 weeks. Initial contracts will be for 6 months, with the potential for the right individuals to move into permanent positions longer term. The vendor is ready to commence, so these resources are needed quickly to work alongside the vendor and help shape and execute the data strategy.

Key experience require d:

• Strong experience delivering large-scale data platform / data transformation programs.
• Proven experience migrating legacy SQL databases into a modern Enterprise Data Warehouse (EDW) environment.
• Strong Snowflake experience, with Snowflake sitting at the centre of the target data architecture.
• Experience designing and/or delivering data ingestion pipelines.
• Experience with cloud-hosted data solutions, ideally across Azure or AWS.
• Comfortable working closely with third-party vendors/consultancies, internal stakeholders and technical teams.
• They need senior, hands-on people rather than junior resources.
• Someone who can come in, understand the environment quickly and contribute to both the strategy and delivery rather than needing significant direction.

Data Engineer skill requirement:

The Data Engineer builds the pipelines and data structures that move data from the legacy environment into Snowflake and make it usable. Extracting data from legacy SQL databases Designing and building ingestion pipelines ETL/ELT development Transforming and loading data into Snowflake SQL development Data modelling and EDW structures Data quality and reconciliation Pipeline orchestration Performance optimisation Potentially tools such as DBT, Azure Data Factory, Databricks, Airflow or Snowflake-native tooling, depending on their chosen architecture