Senior Data Engineer: Real-Time Data Pipelines & Lakes

Elysium Digital; Sydney; On-site; AUD 130,000 - 180,000; Full time

Job summary

Elysium Digital is seeking Senior Data Engineers to design, build, and optimise enterprise-scale data platforms. You will enhance data lakes, data warehouses, and analytics environments while delivering scalable data pipelines and real-time processing within a collaborative, agile team.

You will implement ETL/ELT workflows, support production data platforms, and drive CI/CD practices for data solutions. Strong SQL, Python, and cloud experience are essential in a regulated enterprise setting.

Qualifications

• Baseline Clearance required.
• Experience as a Data Engineer in complex enterprise environments.
• Strong SQL and data engineering capabilities.
• Experience building scalable data pipelines and integration solutions.
• Hands-on with cloud platforms (AWS and/or Azure).
• Knowledge of CI/CD methodologies and DevOps practices.
• Experience supporting production data platforms and resolving operational issues.
• Strong problem-solving and analytical skills.
• Excellent stakeholder engagement and communication abilities.
• Experience with real-time streaming and event-driven architectures.
• Python or other data engineering programming languages.
• Experience with BI and reporting platforms.
• Data governance and data quality frameworks.
• Experience in regulated or enterprise environments.
• Big Data technologies and distributed data processing.

Responsibilities

• Design, develop and maintain scalable data pipelines and data integration solutions.
• Support and enhance enterprise Data Lake and Data Warehouse platforms.
• Build and optimise batch and real-time data processing solutions.
• Develop ETL/ELT frameworks and data workflows.
• Implement CI/CD practices for data engineering solutions.
• Monitor platform performance, reliability and data quality.
• Investigate and resolve data-related incidents and production issues.
• Collaborate with architects, analysts, developers and stakeholders.
• Contribute to data engineering standards and practices.
• Produce technical documentation and knowledge-sharing.

Skills

Data engineering

SQL

Python

CI/CD

DevOps

Troubleshooting

Stakeholder comms

Real-time streaming

Big data

Regulated environments

Tools

AWS

Azure

ETL/ELT frameworks

Job description

Elysium Digital is seeking Senior Data Engineers to design, build, and optimise enterprise-scale data platforms. You will enhance data lakes, data warehouses, and analytics environments while delivering scalable data pipelines and real-time processing within a collaborative, agile team.

You will implement ETL/ELT workflows, support production data platforms, and drive CI/CD practices for data solutions. Strong SQL, Python, and cloud experience are essential in a regulated enterprise setting.