Senior Data Engineer: AI-Enhanced Data Pipelines

Investa; Sydney; Hybrid; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Generous parental leave

Flexible work options

Job summary

Investa is seeking a Senior Data Engineer to join our Sydney team on a 12-month max-term contract. You will design and maintain data pipelines with Azure Databricks, build analytics-ready datasets and develop AI-assisted applications to unlock opportunities and improve decision-making.

The role requires 3+ years of production data experience, strong SQL/Python skills, and familiarity with Delta Lake and Governance.

Qualifications

• 3+ years building and supporting production data pipelines (Databricks/Spark)
• Strong SQL and Python/PySpark skills
• Experience with Delta Lake and data governance practices
• Experience developing AI-assisted applications and APIs
• Knowledge of Azure cloud fundamentals and CI/CD processes

Responsibilities

• Design, build and maintain data pipelines using Azure Databricks and Delta Lake
• Create analytics-ready datasets for reporting, Power BI, and AI use cases
• Develop AI-assisted apps and tools including data extraction and AI agents
• Utilise AI coding assistants while ensuring quality, security and governance
• Monitor data platforms in production and improve performance and reliability
• Collaborate with IT, Finance, Leasing, Sustainability and other teams to translate needs into data/AI solutions
• Promote data literacy and responsible use of data/AI across Investa

Skills

SQL & Python

Databricks

Delta Lake

AI/LLM applications

Data governance

Git & CI/CD

Azure cloud

Power BI

Communication

Education

Degree in Computer Science / Data Engineering / Engineering

Tools

Databricks

Apache Spark

Delta Lake

Git

Power BI

Job description

Investa is seeking a Senior Data Engineer to join our Sydney team on a 12-month max-term contract. You will design and maintain data pipelines with Azure Databricks, build analytics-ready datasets and develop AI-assisted applications to unlock opportunities and improve decision-making.

The role requires 3+ years of production data experience, strong SQL/Python skills, and familiarity with Delta Lake and Governance.