Data Engineer

Profectus; Canberra; On-site; AUD 110,000 - 150,000; Full time

Job summary

Profectus is seeking multiple experienced Data Engineers to build data integration services and migrate data assets to an enterprise data platform for an Australian Government agency. The role involves designing and implementing data pipelines, data migration, data quality remediation, and data modelling to support a secure Angular web application.

Onsite in Canberra, with NV2-level security clearance required.

Qualifications

• Experience designing and building data pipelines.
• Experience migrating data between platforms.
• Strong SQL and data modelling experience.
• Python or similar language for data engineering.
• Experience supporting data used by Angular-based web applications.
• Security clearance: Australian citizenship with NV2 or higher.

Responsibilities

• Design and implement data integration services.
• Build and maintain data pipelines.
• Migrate data assets to target enterprise data platforms.
• Manage data quality and remediate data issues.
• Undertake data modelling, transformation and optimisation.
• Work with developers to manage the impact of data changes on the web application.
• Document pipelines, data models and migration activities.
• Transfer knowledge to government staff.

Skills

Data pipeline design

SQL

Data modelling

Data quality management

Python

Angular data support

Tools

Cloudera

Apache Spark

Job description

Profectus is seeking multiple experienced Data Engineers to build data integration services and migrate data assets to an enterprise data platform within an Australian Government agency. The data supports a secure Angular web application that aggregates data from multiple authoritative sources. The work covers data integration, pipeline development, data migration, data quality remediation and data modelling.

Key Responsibilities

• Design and implement data integration services
• Build and maintain data pipelines
• Migrate data assets to target enterprise data platforms
• Manage data quality and remediate data issues
• Undertake data modelling, transformation and optimisation
• Work with developers to manage the impact of data changes on the web application
• Document pipelines, data models and migration activities
• Transfer knowledge to government staff

Required Experience

• Experience as a Data Engineer designing and building data pipelines
• Experience migrating data between platforms
• Strong SQL and data modelling experience
• Experience with data quality management and remediation
• Experience with Python or a similar language for data engineering
• Experience supporting data used by Angular-based web applications
• Experience working within Defence or another Australian Government agency

Desirable Experience

• Experience with the Defence One Defence Data platform
• Experience with enterprise data platforms such as Cloudera, including Apache Spark
• Experience working within the Defence Secret environment or other classified environments
• Experience applying data governance and data management practices

Security Clearance Requirements

• Must be an Australian Citizen
• Must have a current AGSVA NV2 Security Clearance (minimum)

Working Arrangements

• Onsite
• Canberra

Why Profectus

Profectus partners with Australian Government agencies to deliver trusted ICT capability across complex delivery programs. We take a long term, relationship driven approach, supporting our people across the full lifecycle of their engagement while contributing to outcomes of national importance.