Data Engineer

Mane Consulting; Canberra; On-site; AUD 110,000 - 150,000; Full time

Job summary

Mane Consulting is seeking a Data Engineer to drive the data roadmap and mature analytics across a fast-growing organization in Canberra. You will build robust data pipelines, models, and governance using Azure, Spark, and Power BI, enabling strategic insights.

The role emphasizes hands-on delivery and clear communication within cross-functional teams. You will work with Azure Data Factory, Databricks, Synapse, and Fabric to design scalable, reliable data solutions that empower business

Qualifications

• Experience with data warehousing, ETL/ELT processes, and dimensional data modeling.
• Hands-on with Azure data services for analytics and data integration.

Responsibilities

• Create and manage data pipelines for ingestion, transformation, and loading (ETL/ELT) of data into the Azure data ecosystem.
• Leverage Microsoft Purview, Azure Synapse Analytics, and Power BI for analytics at scale.
• Proficient with Azure Data Factory, Azure Databricks, Delta Lake, and Azure Synapse Analytics to build scalable data solutions.
• Utilize Microsoft Fabric for data integration, orchestration, and analytics across the organization.
• Design data models supporting analytical and operational workloads with data quality and performance in mind.
• Optimize storage, indexing, partitioning, and query performance for efficient resource use.

Skills

ETL/ELT

Data Warehousing

Data Modeling

Azure Data Factory

Azure Synapse Analytics

Azure Databricks

Power BI

PySpark

Delta Lake

SQL Server

Tools

Azure Data Factory

Azure Databricks

Azure Synapse Analytics

Delta Lake

Power BI

Microsoft Fabric

SQL Server

PySpark

Job description

At this industry disrupter you will have the rare opportunity to see how your work impacts the trajectory of a rapid-growth company. They are looking for a Data Engineer to help deliver on the strategic data roadmap that will quickly evolve the maturity of the business. this organisations wants someone with technical and communication skills, who is hungry to have an impact, and is not satisfied with mediocrity.

Do you love data and data pipelines? Does your brain wrangle data in your sleep? Do you like to use and deliver data in a meaningful way?

Responsibilities:

• Create and manage data pipelines that enable the ingestion, transformation, and loading (ETL/ELT) of data from various sources into our Azure data ecosystem.
• The Data Engineer must understand the methods and practices for performing advanced analytics at scale with Microsoft Purview, Microsoft Azure Synapse Analytics, and Microsoft Power BI.
• They must be proficient in the use of Azure Data Factory, Azure Synapse Analytics, Azure Stream Analytics, Azure Event Hubs, Azure Data Lake Storage, and Azure Databricks for creating data processing solutions.
• Leverage Microsoft Fabric for data integration, orchestration, and analytics, ensuring seamless data flow and accessibility across the organization.
• Utilize Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure services to build scalable data solutions that meet business needs.
• Data Modeling: Design and implement efficient data models that support analytical and operational workloads, ensuring data quality, consistency, and performance.
• Optimization and Performance Tuning: Optimize data storage and retrieval processes, including indexing, partitioning, and query performance tuning, to ensure efficient use of resources.

To Succeed in this role you will you have:

• Data Engineering foundations: solid experience in data warehousing, ETL/ELT processes, and data modeling (dimensional, normalized)
• Previous hands-on work with a broad range of Azure services related to Data and Analytics, including Azure Data Factory, Azure Databricks, Delta Lake, and Azure Synapse Analytics
• Proficient in T-SQL, SQL Server, Databricks, PySpark, SSRS, Power BI, and other related data tools and platforms
• Ability to extract and transform disparate data into actionable insights that will drive business decisions. Applying industry best practice transformation and modeling techniques - validating the output to ensure reliable and accurate results for consumption by downstream data teams, and end users.
• Drive development projects to evolve our platform and operations, leveraging the newest Microsoft technologies available to us.

Mane Consulting specialise in Data & Analytics.