Azure Data Engineer

SoftLabs; Sydney; On-site; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Collaborative team

Onsite work

Career development

Inclusive culture

Job summary

SoftLabs is an Australian-owned, women-led Enterprise Software company specialising in Industry Automation Solutions, ERP Implementation, consulting, project management, software development, and assured services. We foster a collaborative and innovative environment where your contributions are valued and your growth is supported.

The Azure Data Engineer will build and maintain secure, reliable data pipelines and platforms, preparing data for reporting and analysis.

Responsibilities

• Design, develop and maintain secure, scalable data pipelines.
• Ingest, transform, validate and deliver data from various sources.
• Build data solutions using Azure Data Factory, Databricks, Data Lake Storage and SQL.
• Develop ETL/ELT processes using SQL, Python or PySpark.
• Design and maintain data models, databases and data lakes to support reporting.
• Monitor data pipelines and resolve performance, reliability and data-quality issues.
• Apply CI/CD and DataOps practices for changes and deployments.
• Ensure compliance with agency security, privacy and data governance requirements.
• Collaborate with analysts, architects and infrastructure teams to meet requirements.
• Explain technical issues and progress to stakeholders.

Job description

SoftLabs is an Australian-owned, women-led Enterprise Software company specialising in Industry Automation Solutions, ERP Implementation, consulting, project management, software development, and assured services. We pride ourselves on fostering a collaborative and innovative work environment where your contributions are valued and your professional growth is supported.

About the role

The Azure Data Engineer will build and maintain secure, reliable data pipelines and platforms, preparing data for reporting and analysis. They will work with technical and business teams to ensure data is accurate, well managed and accessible to authorised users.

Key responsibilities

• Design, develop and maintain secure, scalable data pipelines to ingest, transform, validate and deliver data from government systems and other sources
• Build and support data engineering solutions using Azure services such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage and Azure SQL or SQL Server
• Develop and optimise ETL/ELT processes and use SQL, Python or PySpark to transform, join and validate complex datasets
• Design and maintain data models, databases and data lakes that support reporting, analytics and evidence-based decision-making
• Monitor data pipelines and resolve performance, reliability, data-quality and production issues
• Implement testing, version control, CI/CD and DataOps practices to manage changes and deployments
• Apply relevant agency security, privacy, access-control, data-governance and records-management requirements
• Review existing data solutions and recommend improvements to their performance, quality, security and maintainability
• Work with business areas, analysts, architects and infrastructure teams to understand requirements and deliver data solutions
• Explain technical issues, risks and recommendations clearly to technical and non-technical stakeholders, and provide progress updates

What’s In It for You?

• Be part of a collaborative, high-performing team
• Work onsite with leading clients across key industries
• Career development, mentoring, and continuous learning opportunities
• Inclusive, innovative, and supportive company culture

Build relationships. Drive solutions. Make your mark - with SoftLabs.

Be careful - Don’t provide your bank or credit card details when applying for jobs. Don't transfer any money or complete suspicious online surveys. If you see something suspicious, report this job ad .