Senior Data Engineer: AI-Driven Data Platforms on Azure

Investa Property Group; Sydney; On-site; AUD 140,000 - 180,000; Full time

Benefits offered by this job

Career development

Flexible work options

Parental leave

Inclusive culture

Health and wellness

Financial benefits

Job summary

Investa Property Group in Sydney seeks a Senior Data Engineer to design and maintain modern data pipelines and AI-enabled solutions. You’ll leverage Azure Databricks, Delta Lake and Power BI to deliver analytics-ready datasets for reporting and insights.

Join a collaborative team focused on governance, security and scalable data platforms while exploring AI-assisted tools to streamline processes and unlock opportunities across the organisation.

Qualifications

• 3+ years building and supporting production data pipelines (Databricks or Apache Spark preferred).
• Strong SQL and Python/PySpark with data modelling, lakehouse concepts and data quality practices.
• Experience with Delta Lake, data orchestration and scalable data solutions.
• Practical experience developing AI-assisted applications, including APIs and AI agents/tools.
• Confidence using AI coding assistants with judgment to review, test and validate output.
• Understanding of data governance, privacy and information security principles.
• Working knowledge of Git, CI/CD and Azure cloud fundamentals.
• Excellent communication to explain technical concepts to non-technical stakeholders.

Responsibilities

• Design, build and maintain data pipelines with Azure Databricks, Delta Lake and orchestration tools.
• Develop analytics-ready datasets to support reporting, Power BI, insights and AI use cases.
• Build AI-assisted applications and tools, including document and lease data extraction and internal apps.
• Use AI coding assistants to accelerate development while maintaining quality and security.
• Apply data governance, access controls and data quality checks to ensure trusted data.
• Monitor and support data platforms in production; improve performance and reliability.
• Collaborate with IT, Cyber, Transformation, Asset Management, Leasing, Finance and Sustainability teams.
• Help build data literacy by enabling employees to use data and AI tools responsibly.

Skills

SQL

Python/PySpark

Data modelling

Lakehouse architecture

Data governance

AI applications

CI/CD

Communication

Education

Degree in Computer Science / Data Engineering or related field

Tools

Azure Databricks

Delta Lake

Power BI

APIs

Git

CI/CD

Azure cloud fundamentals

Job description

Investa Property Group in Sydney seeks a Senior Data Engineer to design and maintain modern data pipelines and AI-enabled solutions. You’ll leverage Azure Databricks, Delta Lake and Power BI to deliver analytics-ready datasets for reporting and insights.

Join a collaborative team focused on governance, security and scalable data platforms while exploring AI-assisted tools to streamline processes and unlock opportunities across the organisation.