Senior Data Engineer: Microsoft Fabric & AI Lead

Tridant Pty Ltd; Sydney; On-site; AUD 180,000 - 240,000; Full time

Benefits offered by this job

Flexible work arrangements

Learning & development opportunities

Wellbeing perks

Job summary

Tridant Pty Ltd in Sydney or Melbourne seeks an experienced Senior Consultant to design, build, and maintain robust data solutions using Microsoft Fabric and related technologies. You will bridge business needs with technical solutions in an Agile, client-facing environment.

You will lead end-to-end data pipelines, mentor engineers, and collaborate across teams to deliver scalable platforms. 5+ years in data engineering and strong Fabric/Synapse/Python expertise are essential.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 5+ years of experience in data engineering roles.
• Strong expertise in Microsoft Fabric, including Data Factory, Synapse Analytics, and Power BI.
• Advanced Python programming skills with experience in data processing libraries (pandas, numpy, pyspark).
• Proven experience with Azure Synapse Analytics, including SQL pools and Spark pools.
• Strong understanding of data warehousing concepts and dimensional modelling.
• Experience working in Agile environments with Scrum methodology.
• Excellent understanding of CI/CD pipelines and DevOps practices.
• Strong SQL skills and experience with large-scale data processing.
• Experience with Databricks and Delta Lake architecture.
• Knowledge of data governance and security best practices.
• Microsoft Fabric Data Engineer certification and/or Azure Data Engineer Associate certification.
• Experience with real-time data processing and streaming technologies.
• Familiarity with Infrastructure as Code (IaC) tools.
• Experience with version control systems (Git) and collaborative development.
• Experience with Generative AI and Large Language Models integration.

Responsibilities

• Lead the design and implementation of end-to-end data pipelines using Microsoft Fabric, ensuring optimal performance, scalability, and reliability of data infrastructure.
• Develop and maintain data transformation processes using Python, implementing best practices for code quality and documentation.
• Architect and implement solutions using Microsoft Fabric, creating efficient data warehousing, lakehouse, and analytics solutions.
• Collaborate with cross-functional teams using Agile/Scrum methodologies, participating in sprint planning, daily stand-ups, and retrospectives.
• Design and implement data quality frameworks and monitoring solutions to ensure data accuracy and reliability.
• Mentor junior engineers and contribute to technical decision-making processes.
• Optimize existing data pipelines and implement automation solutions for improved efficiency.

Skills

Microsoft Fabric

Python

SQL

Azure Synapse Analytics

Power BI

Databricks

Delta Lake

Pandas/Numpy/PySpark

Education

Bachelor's degree in Computer Science or related

Tools

Microsoft Fabric Data Factory

Synapse Analytics

Power BI

Git

CI/CD

Infrastructure as Code

Job description

Tridant Pty Ltd in Sydney or Melbourne seeks an experienced Senior Consultant to design, build, and maintain robust data solutions using Microsoft Fabric and related technologies. You will bridge business needs with technical solutions in an Agile, client-facing environment.

You will lead end-to-end data pipelines, mentor engineers, and collaborate across teams to deliver scalable platforms. 5+ years in data engineering and strong Fabric/Synapse/Python expertise are essential.