Lead Data Engineer

Trident Group; Australian Capital Territory; Hybrid; AUD 140,000 - 180,000; Full time

Job summary

Trident Group in ACT seeks a Lead Data Engineer to design, code, train and optimize machine learning workflows, focusing on geospatial Earth Observation data and Open Data Cube. You will develop and maintain ingest pipelines, containerised deployments on AWS, and ensure robust automated testing and security practices.

You will provide technical leadership, transfer knowledge to scientists, and collaborate with stakeholders across technical and non-technical teams to ensure high-performing

Qualifications

• Experience with large geospatial datasets in cloud environments.
• Knowledge of protocols for data access and editing.
• Ability to provide strategic guidance on data processes and tooling.
• Technical leadership across software development to deliver secure, high-quality solutions.
• Strong stakeholder communication across technical and non-technical audiences.

Responsibilities

• Design, code, train, validate and optimise ML workflows with orchestration.
• Develop and maintain Open Data Cube code base.
• Build and maintain data ingest and transformation pipelines.
• Implement automated testing and CI/CD on AWS.
• Lead standards for secure data engineering practices.
• Upskill Earth Observation scientists and communicate complex concepts.

Skills

Python

AWS

Open Data Cube

Data orchestration

Containerisation

Geospatial data

ETL / Data Pipelines

CI/CD

Machine learning workflows

Stakeholder communication

Job description

# Lead Data EngineerJob Reference: #9994Federal Government AgencyBaseline RequiredAustralian CitizenData Operations team, Data and Systems (DaS) sectionACTContractCloses 11/11/2026PythonAWSOpen Data CubeContainerisationData Engineering OrchestrationMachine Learning WorkflowsCI/CD PipelinesGeospatial Data AnalysisETL / Data PipelinesAutomated TestingShare## About the RoleRole Overview:Design, code, train, validate, maintain and optimise machine learning workflows, with orchestration, testing and documentation; support development and maintenance of data source, ingest and transformation pipelines; develop, test and maintain the Open Data Cube code base; transfer knowledge to and upskill Earth Observation scientists; advise on improvements to existing algorithms; implement, maintain and improve automated testing and deployment pipelines on AWS for various platforms; contribute to and drive a strong collaborative culture; ensure services and components are available and high performing; embed security tools and practices into systems and CI/CD pipelines; support data operations as directed by DaS leadership; other administrative tasks as required. The role sits in the Data Operations team of the Data and Systems (DaS) section and supports Earth Analysis scientific products and infrastructure, with a focus on data management, IT system support and Earth observation product support, considering cybersecurity in planning, delivery and monitoring and aligning with branch governance frameworks.Key Responsibilities:• Large geospatial and Earth observation datasets in a cloud environment; Open Data Cube code base development, testing and maintenance.• Data engineering orchestration, containerisation and Python - essential.• Design, code, train, validate, maintain and optimise machine learning workflows with orchestration, testing and documentation.• Data ingest and transformation pipelines; protocols for data access and editing.• Automated testing and deployment pipelines on AWS; security tools and practices embedded in systems and CI/CD; service availability and performance.• Technical leadership of software development practices, tools and standards for secure, high-quality solutions; strategic advice on use and reuse of data processes, systems and tools.• Upskill Earth Observation scientists, advise on algorithm improvements, and communicate complex concepts to technical and non-technical audiences.### About the ClientA federal government agency focused on geoscience, earth observation, and national spatial data infrastructure.## RequirementsEssential CriteriaYour response must demonstrate experience against each of the following:1. Demonstrated experience working with large, geospatial datasets within a cloud environment.2. Comprehensive knowledge of protocols associated with data access and editing.3. Demonstrated experience providing strategic advice and guidance on the use and reuse of data processes, systems and tools.4. Provide technical leadership across software development, driving the adoption of development practices, tools and standards to deliver secure, high-quality solutions.5. The ability to work effectively with technical and non-technical stakeholders, and communicate complex concepts across a range of audiences.Desirable CriteriaThe following are advantageous but not mandatory:• Build and sustain strong relationships and collaboration while fostering an inclusive, high-performing team environment.Interested in this role? Submit your application today.