Lead Data Engineer

Pinaka

Canberra

Hybrid

AUD 150,000 - 200,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Pinaka is seeking a Lead Data Engineer to drive data integration and warehousing initiatives in a hybrid setup across QLD/WA/ACT/VIC. The role focuses on ETL/ELT development, data quality, and scalable data architectures to support analytics and operations.

The successful candidate will design, build and optimise data pipelines, collaborate with stakeholders, and lead a cross-functional team to deliver robust data ecosystems across enterprise data warehouses and data lakes.

Qualifications

  • Experience with Teradata EDW environments and data integration
  • Ability to design and implement ELT processes
  • Strong SQL development and data quality focus
  • Ability to translate technical concepts for non-technical staff

Responsibilities

  • Lead data engineering initiatives to build data warehouses and lakes
  • Develop and optimise ETL/ELT processes and data flows
  • Collaborate with stakeholders to gather requirements and deliver data solutions
  • Mentor and guide cross-functional agile teams to deliver data outcomes

Skills

ETL development
Teradata EDW
SQL
Data quality
Data integration
Team leadership

Tools

Teradata Studio Viewpoint
Pcom
Control-M
SQL Assistant

Job description

Lead Data Engineer

Location: QLD/WA/ACT/VIC (Hybrid).

Data Engineers prepare raw data for analytical or operational uses. They make data accessible so that it can be used for optimisation, delivery of services and enhanced analytics solutions.

Key Duties and Responsibilities
  • Support in the delivery of data assets by contributing to improving data management capabilities, including building data integration applications that extract
  • Transform, and load (ETL) data and metadata into data warehouses + Data Lake (RDBMS/HDFS)
  • Undertake analysis, design, development, prototyping, testing and maintenance activities in a Teradata EDW environment
  • Contribute to building and maintaining automated data integration applications by developing complex SQL programs within a Teradata EDW environment
  • Perform analysis of technical requirements to support project evaluation with proposed solutions
  • Ensure excellent data quality and high standards in Management Information solutions
  • Development of ELT solutions using a variety of industry tools including SQL Assistant, Terada Studio Viewpoint, Pcom and Control-M
  • Write/explain technical systems, problems and outcomes using unambiguous language to non-technical staff
  • Strong focus on data integrity between source and destinations systems
  • Analyse and evaluate complex business process and requirement
  • Work with stakeholders to assemble large, complex data sets that meet current and potential business requirements
  • Design and implement data flows connecting operational systems, using data analysis and modelling to build, maintain, and optimise data structures that support controlled data extraction for analytics and business intelligence
  • Manage the build of data streaming systems, and development of management information solutions
  • Manage the design, development and maintenance of enterprise data warehouse, data lake and data engineering solutions
  • Lead the optimisation of data extraction solutions, providing technical guidance on complex query and programming functions to deliver data outcomes aligned to stakeholder and agency requirements
  • Perform analysis on data and processes to address business questions, identify opportunities for improvement and provide support to staff
  • Manage the development of data engineering frameworks and best practices for processes aimed at enhancing the availability, security and performance of data assets
  • Review and prepare corporate and technical documentation for review by senior staff
  • Provide feedback to staff and stakeholders to improve quality, consistency and accuracy of decision making
  • Lead collaboration across cross-functional agile teams to deliver data engineering solutions
  • Lead and manage team operations to deliver business and strategic outcomes, setting priorities and allocating resources effectively
  • Lead and manage staff to enhance performance and engagement by providing coaching, developing capabilities, managing performance, and supporting health and well-being
  • Act with integrity by promoting workplace practices aligned with the APS Values and the APS Code of Conduct
  • Exercise delegation in accordance with legislation and guidelines
Technical Skills
  • recognise and initiate opportunities to re-use and align data models
  • undertake data profiling, source system analysis and synthesis, and support the end use of data
  • use metadata repositories to support complex data and systems integration impact analysis and business outcomes
  • design, build and test complex or large data products using agreed standards, technologies and access methods to deliver repeatable, reusable solutions and strengthen team capability in data integration services
  • apply expert skills in data quality, cleansing and validation
  • promote the strategic data vision through effective work practices and active participation in collaborative forums
  • translate and present technical information for non-technical audiences
Selection Criteria
  • Has a comprehensive knowledge of protocols associated with data access.
  • Is an expert resource on different methods of data editing and advises others Can assess current editing methods critically Can build capability of others in data editing concepts and methods
  • Data integrity and quality assurance: Level 3 (DCF)
  • Is an expert resource in the use of measures for data quality assurance, the interaction of those measures, and their application in conjunction with one another Can advise others on the use of data quality measures to make accurate assessments of data fitness-for purpose (including trustworthiness and accuracy) Is an expert resource on ensuring data integrity across its lifecycle, and advises others
  • Data use and re-use: Level 3 (DCF)
  • Is a leading strategic adviser on the use of organisational data assets Is an expert resource on the design and management of organisational data assets as open data. Promotes re-use and ongoing value of data across wider contexts, in accordance with legislative requirements and organisational guidelines (includes data sharing legislation)
  • Improvement and Innovation - Data processes/systems and tools/products: Level 3 (DCF)
  • Thinks strategically to assess current processes/systems and tools/ products across a broad context Develops improvements where needed and encourages others to think critically about processes/systems and tools/ products relevant to them Advises those leading changes to processes / systems and tools/ products, measures resultant benefits, and makes recommendations Understands the impact of new trends and innovations on organisational data processes, systems and tools, and products Maintains understanding of new trends and innovations relating to data processes, systems and tools, and products within the organisation and externally. Provides technical expertise for systems testing, including validating the quality of the testing approach and results
  • Can perform and provide expert advice on data integration Can build capability of others in understanding and applying good data integration practice and principles Can write custom scripts and code (programming language) to integrate data Maintains understanding of new trends and innovations relating to integrating data (including Artificial Intelligence-based technologies) and develops skills in these where relevant
  • Value organisational data as assets: Level 3 (DCF)
  • Has a comprehensive understanding of the data assets available to the organisation and understands how these assets contribute strategic value Looks for new ways to obtain value from organisational data assets Can advise on how organisational data assets contribute value in broader data contexts Is an expert resource on the broader and strategic environment when drawing insights from data. Uses this expertise to make informed, evidence-based decisions and recommendations and act accordingly.
Essential criteria
  • Data access: Level 2 (DCF)
  • Has a comprehensive knowledge of protocols associated with data access.
  • Data editing: Level 3 (DCF)
  • Is an expert resource on different methods of data editing and advises others Can assess current editing methods critically Can build capability of others in data editing concepts and methods
  • Data integrity and quality assurance: Level 3 (DCF)
  • Is an expert resource in the use of measures for data quality assurance, the interaction of those measures, and their application in conjunction with one another Can advise others on the use of data quality measures to make accurate assessments of data fitness-for purpose (including trustworthiness and accuracy) Is an expert resource on ensuring data integrity across its lifecycle, and advises others
  • Data use and re-use: Level 3 (DCF)
  • Is a leading strategic adviser on the use of organisational data assets Is an expert resource on the design and management of organisational data assets as open data. Promotes re-use and ongoing value of data across wider contexts, in accordance with legislative requirements and organisational guidelines (includes data sharing legislation)
  • Improvement and Innovation - Data processes/systems and tools/products: Level 3 (DCF)
  • Thinks strategically to assess current processes/systems and tools/ products across a broad context Develops improvements where needed and encourages others to think critically about processes/systems and tools/ products relevant to them Advises those leading changes to processes / systems and tools/ products, measures resultant benefits, and makes recommendations Understands the impact of new trends and innovations on organisational data processes, systems and tools, and products Maintains understanding of new trends and innovations relating to data processes, systems and tools, and products within the organisation and externally. Provides technical expertise for systems testing, including validating the quality of the testing approach and results
  • Integrate data: Level 3 (DCF)
  • Can perform and provide expert advice on data integration Can build capability of others in understanding and applying good data integration practice and principles Can write custom scripts and code (programming language) to integrate data Maintains understanding of new trends and innovations relating to integrating data (including Artificial Intelligence-based technologies) and develops skills in these where relevant
  • Value organisational data as assets: Level 3 (DCF)
  • Has a comprehensive understanding of the data assets available to the organisation and understands how these assets contribute strategic value Looks for new ways to obtain value from organisational data assets Can advise on how organisational data assets contribute value in broader data contexts Is an expert resource on the broader and strategic environment when drawing insights from data. Uses this expertise to make informed, evidence-based decisions and recommendations and act accordingly.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer – Data Engineering | Multiple locations | Baseline
Lead Data Engineer – Data Engineering | Multiple locations | Baseline

Canberra, Australian Capital Territory, Australia Services Australia • Canberra

Hybrid
AUD 140,000 - 200,000
Lead Data Engineer – Data Engineering | Multiple locations | Baseline
Lead Data Engineer – Data Engineering | Multiple locations | Baseline

Pinaka Technology Solutions • Canberra

Hybrid
AUD 130,000 - 170,000
El1 Lead Data Engineer
El1 Lead Data Engineer

Softtest Pays Pty Ltd • Adelaide

On-site
AUD 120,000 - 180,000
Lead Data Manager (Data Assurance)
Lead Data Manager (Data Assurance)

Trident Group • Australia

Remote
AUD 90,000 - 130,000
Senior Data Analyst (Metadata)
Senior Data Analyst (Metadata)

Indigitise Pty Ltd • Canberra

On-site
AUD 110,000 - 140,000
Senior Data Analyst (Metadata)
Senior Data Analyst (Metadata)

Indigitise • Canberra

On-site
AUD 120,000 - 150,000
El1 Lead Data Analyst
El1 Lead Data Analyst

Softtest Pays Pty • Adelaide

On-site
AUD 120,000 - 160,000
Data Analyst
Data Analyst

IT Alliance • Melbourne

On-site
AUD 110,000 - 150,000
Lead Data Manager
Lead Data Manager

Ressam • Tasmania

Hybrid
AUD 120,000 - 180,000
Senior Data/Geospactial Engineer
Senior Data/Geospactial Engineer

Work Initiatives • North Sydney

On-site
AUD 140,000 - 180,000
Top locations