EL1 Lead Data Engineer

Softtest pays pty ltd

Brisbane

Vor Ort

AUD 120.000 - 150.000

Vollzeit

Vor 9 Tagen

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Softtest pays pty ltd is seeking an experienced Data Engineer to design, build, and maintain data products and platforms supporting analytical and operational needs in an agency context. You will transform data across the lifecycle, ensure security and reliability, and collaborate with stakeholders to deliver scalable data solutions.

The role requires expertise in data integration, ETL/ELT, and data governance, with leadership responsibilities in data engineering capabilities to drive strategic

Qualifikationen

  • Experience designing and building data products and pipelines.
  • Proficient in ETL, ELT processes and data integration.
  • Strong knowledge of data warehousing and data lakes.
  • Ability to translate technical concepts for non-technical stakeholders.

Aufgaben

  • Support delivery of data assets by building data integration applications.
  • Transform and load data into data warehouses and data lakes.
  • Undertake analysis, design, development, prototyping, testing and maintenance in a Teradata EDW environment.
  • Contribute to building and maintaining automated data integration applications by developing complex SQL programs within a Teradata EDW environment.
  • Perform analysis of technical requirements to support project evaluation with proposed solutions.
  • Ensure excellent data quality and high standards in Management Information solutions.
  • Development of ELT solutions using industry tools including SQL Assistant, Teradata Studio Viewpoint, Pcom and Control-M.
  • Write/explain technical systems, problems and outcomes using unambiguous language to non-technical staff.
  • Strong focus on data integrity between source and destination systems.
  • Analyse and evaluate complex business process and requirement.
  • Work with stakeholders to assemble large, complex data sets that meet business requirements.
  • Design and implement data flows connecting operational systems, using data analysis and modelling to build, maintain, and optimise data structures for analytics.

Kenntnisse

Data profiling
Data modelling
ETL development
SQL programming
Stakeholder communication
Data governance & security

Tools

Teradata EDW
SQL Assistant
Teradata Studio Viewpoint
Control-M
Pcom

Jobbeschreibung

Australian Citizens residing in Australia only respond.

Job details

Data Engineers prepare raw data for analytical or operational uses. They make data accessible so that it can be used for optimisation, delivery of services and enhanced analytics solutions.

The Data Engineers will design, build and maintain data products, services and platforms that support the agency's operational, analytical and business intelligence needs. They will transform and manage data throughout the data lifecycle to ensure data assets are secure, reliable, accessible and fit for purpose. The Data Engineers will work collaboratively with business and technical stakeholders to deliver scalable data solutions, support evidence-based decision making, and contribute to the continuous improvement of the agency's data ecosystem.

Data Engineer Experts will provide technical leadership in the design, delivery and optimisation of complex data engineering capabilities. They will drive improvements to data services, governance, security and operational performance, while resolving complex technical challenges. The Data Engineer Experts will influence stakeholders, contribute to strategic initiatives and organisational outcomes, and provide expert advice and guidance to support the delivery of high-quality data engineering solutions.

Technical Skills:
  • recognise and initiate opportunities to re-use and align data models
  • undertake data profiling, source system analysis and synthesis, and support the end use of data
  • use metadata repositories to support complex data and systems integration impact analysis and business outcomes
  • design, build and test complex or large data products using agreed standards, technologies and access methods to deliver repeatable, reusable solutions and strengthen team capability in data integration services
  • apply expert skills in data quality, cleansing and validation
  • promote the strategic data vision through effective work practices and active participation in collaborative forums
  • translate and present technical information for non-technical audiences.
The Data Engineers must have extensive knowledge of:
  • The ability to apply existing corporate and technical knowledge to maintain business and delivery continuity.
  • The capability to integrate quickly and contribute effectively within our established delivery environment.
  • End-to-end data lifecycle practices, including design, build and test phases, and data architecture and modelling concepts for data warehousing and data lakes.
The Data Engineers must also have the ability to quickly obtain knowledge of:
  • The agency's strategic outlook and direction.
  • Relevant frameworks, legislation, policies and procedures.
  • Payments, programs and services administered by the agency relevant to work area.
  • The agency's privacy, workplace health and safety and security protocols
  • Relevant knowledge and experience of our systems, platforms, and processes.
  • A strong understanding of Agency business requirements and outcomes.
Key duties and responsibilities
  • Support in the delivery of data assets by contributing to improving data management capabilities, including building data integration applications that extract.
  • Transform, and load (ETL) data and metadata into data warehouses + Data Lake (RDBMS/HDFS).
  • Undertake analysis, design, development, prototyping, testing and maintenance activities in a Teradata EDW environment.
  • Contribute to building and maintaining automated data integration applications by developing complex SQL programs within a Teradata EDW environment.
  • Perform analysis of technical requirements to support project evaluation with proposed solutions.
  • Ensure excellent data quality and high standards in Management Information solutions.
  • Development of ELT solutions using a variety of industry tools including SQL Assistant, Terada Studio Viewpoint, Pcom and Control-M.
  • Write/explain technical systems, problems and outcomes using unambiguous language to non-technical staff.
  • Strong focus on data integrity between source and destinations systems.
  • Analyse and evaluate complex business process and requirement.
  • Work with stakeholders to assemble large, complex data sets that meet current and potential business requirements.
  • Design and implement data flows connecting operational systems, using data analysis and modelling to build, maintain, and optimise data structures that support controlled data extraction for analytics and business intelligence.
  • Manage the build of data streaming systems, and development of management information solutions.
  • Manage the design, development and maintenance of enterprise data warehouse, data lake and data engineering solutions.
  • Lead the optimisation of data extraction solutions, providing technical guidance on complex query and programming functions to deliver data outcomes aligned to stakeholder and agency requirements.
  • Perform analysis on data and processes to address business questions, identify opportunities for improvement and provide support to staff.
  • Manage the development of data engineering frameworks and best practices for processes aimed at enhancing the availability, security and performance of data assets.
  • Review and prepare corporate and technical documentation for review by senior staff.
  • Provide feedback to staff and stakeholders to improve quality, consistency and accuracy of decision making.
  • Lead collaboration across cross-functional agile teams to deliver data engineering solutions.
  • Lead and manage team operations to deliver business and strategic outcomes, setting priorities and allocating resources effectively.
  • Lead and manage staff to enhance performance and engagement by providing coaching, developing capabilities, managing performance, and supporting health and well-being.
  • Act with integrity by promoting workplace practices aligned with the APS Values and the APS Code of Conduct.
  • Exercise delegation in accordance with legislation and guidelines.
Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

El1 Lead Data Engineer
El1 Lead Data Engineer

Softtest Pays Pty Ltd • Adelaide

Vor Ort
AUD 120.000 - 180.000
Lead Data Engineer
Lead Data Engineer

Bright Vision Consulting- Australia • Canberra

Hybrid
AUD 140.000 - 180.000
Lead Data Engineer – Data Engineering | Multiple locations | Baseline
Lead Data Engineer – Data Engineering | Multiple locations | Baseline

Pinaka Technology Solutions • Canberra

Hybrid
AUD 130.000 - 170.000
Lead Data Engineer (Snowflake, Dbt) – 12-Month Fixed-Term Contract
Lead Data Engineer (Snowflake, Dbt) – 12-Month Fixed-Term Contract

Commonwealth Bank Of Australia • Sydney

Hybrid
AUD 150.000 - 210.000
Hybrid working
Lead Data Engineer
Lead Data Engineer

Pinaka • Canberra

Hybrid
AUD 150.000 - 200.000
El1 Lead Data Analyst
El1 Lead Data Analyst

Softtest Pays Pty • Adelaide

Vor Ort
AUD 120.000 - 160.000
El1 Lead Data Analyst
El1 Lead Data Analyst

Softtest Pays Pty Ltd • Melbourne

Vor Ort
AUD 90.000 - 120.000
EL1 Lead Data Engineer
EL1 Lead Data Engineer

Onpoint 365 • Canberra

Vor Ort
AUD 107.000 - 121.000
Lead Data Engineer
Lead Data Engineer

Talent • Melbourne

Hybrid
AUD 180.000 - 210.000
Lead Data Engineer
Lead Data Engineer

Indigitise • Canberra

Hybrid
AUD 110.000 - 140.000
Top-Standorte