Senior Data Engineer

Investa; Sydney; Hybrid; AUD 150,000 - 190,000; Full time

Benefits offered by this job

Generous parental leave

Flexible work options

Job summary

Investa is seeking a Senior Data Engineer to join our Sydney team on a 12-month max-term contract. You will design and maintain data pipelines with Azure Databricks, build analytics-ready datasets and develop AI-assisted applications to unlock opportunities and improve decision-making.

The role requires 3+ years of production data experience, strong SQL/Python skills, and familiarity with Delta Lake and Governance.

Qualifications

• 3+ years building and supporting production data pipelines (Databricks/Spark)
• Strong SQL and Python/PySpark skills
• Experience with Delta Lake and data governance practices
• Experience developing AI-assisted applications and APIs
• Knowledge of Azure cloud fundamentals and CI/CD processes

Responsibilities

• Design, build and maintain data pipelines using Azure Databricks and Delta Lake
• Create analytics-ready datasets for reporting, Power BI, and AI use cases
• Develop AI-assisted apps and tools including data extraction and AI agents
• Utilise AI coding assistants while ensuring quality, security and governance
• Monitor data platforms in production and improve performance and reliability
• Collaborate with IT, Finance, Leasing, Sustainability and other teams to translate needs into data/AI solutions
• Promote data literacy and responsible use of data/AI across Investa

Skills

SQL & Python

Databricks

Delta Lake

AI/LLM applications

Data governance

Git & CI/CD

Azure cloud

Power BI

Communication

Education

Degree in Computer Science / Data Engineering / Engineering

Tools

Databricks

Apache Spark

Delta Lake

Git

Power BI

Job description

Why join us?

We’ve made it our business to understand how people want to live and work today, tomorrow and beyond, and as you’d expect, we practise what we preach in our own workplace as well. We’re known for our supportive, inclusive and flexible work culture. With recognition from the Workplace Gender Equality Agency, the Australian Workplace Equality Index, and multiple awards for workplace flexibility, our people and the way we work together are our difference.

We’re looking for a motivated and curious Senior Data Engineer to join our team in Sydney on a 12-month max-term contract. This is an opportunity to play a key role in shaping how Investa uses data and AI to make better decisions, streamline processes and uncover new opportunities. You’ll build and maintain modern data pipelines and platforms using Azure Databricks, while exploring AI-assisted applications and tools that help our people work smarter. If you enjoy combining strong data engineering fundamentals with emerging AI technologies, this could be the role for you.

Your key responsibilities:

• Design, build and maintain reliable data pipelines using Azure Databricks, Delta Lake and modern data orchestration tools.
• Develop high-quality, analytics-ready datasets to support reporting, Power BI, business insights and AI use cases.
• Build AI-assisted applications and tools, including document and lease data extraction, internal applications and natural-language access to data.
• Use AI coding assistants, such as Claude Code, to accelerate development, testing, documentation and problem‑solving while maintaining quality and security.
• Apply data governance, access controls, data quality checks and security standards to ensure data is trusted, protected and fit for purpose.
• Monitor and support data platforms and applications in production, troubleshooting issues and continually improving performance, reliability and user experience.
• Optimise platform performance and costs, and contribute to CI/CD, deployment processes and development environments.
• Partner with teams across IT, Cyber, Transformation, Asset Management, Leasing, Finance and Sustainability to translate business needs into practical data and AI solutions.
• Help build data literacy across Investa by supporting and enabling employees to use data and AI tools confidently and responsibly.

What you bring:

• A degree in Computer Science, Data Engineering, Engineering or a related discipline, or equivalent practical experience.
• At least three years' experience building and supporting production data pipelines, ideally using Databricks or Apache Spark.
• Strong SQL and Python/PySpark skills, with a solid understanding of data modelling, lakehouse architecture and data quality practices.
• Experience with Delta Lake, data orchestration and building reliable, scalable data solutions.
• Practical experience developing LLM-powered or AI‑assisted applications, including working with APIs, prompt design and AI agents or tools.
• A confident approach to using AI coding assistants to work efficiently, with the judgement to review, test and validate their output.
• An understanding of data governance, responsible AI, privacy and information security principles.
• Working knowledge of Git, CI/CD and Azure cloud fundamentals.
• Strong communication skills, with the ability to explain technical concepts and solutions to non-technical stakeholders.
• A proactive, detail‑oriented and curious mindset, with a willingness to take ownership from initial development through to ongoing support.
• Experience with Power BI, semantic modelling or Databricks certification will be highly regarded. Knowledge of the commercial property sector is also beneficial, but not essential.

What we offer:

Career Development:

Leadership programs, education assistance, study support and professional membership fee support.

Lifestyle:

Generous parental leave, a return‑to‑work program and summer hours.

Inclusive Culture:

A safe, welcoming environment for all, including individuals from Aboriginal and Torres Strait Islander communities, the LGBTQ+ community and those who are neurodivergent.

Flexibility:

We do our best to support you to do the things that are important to you. We offer over 21 formal flexible work options, plus a truly supportive approach to balancing work with life's priorities.

Health and Wellness:

Discounted health insurance, free health and wellbeing services, discounted fitness classes and reproductive health benefits.

Financial:

Fully funded life and TPD insurance, novated leasing and retail discounts.

We encourage people of all backgrounds to apply. Even if you don’t meet all the criteria, we’d love to hear from you.

We understand that traditional hiring processes can come with challenges for some people. If you have a disability, identify as gender diverse or are neurodivergent, please reach out to our Recruitment Manager, [e-mail], and Amy will tailor our processes to accommodate your specific needs. If you require no additional assistance to accommodate your requirements and wish to be considered for this position, kindly submit your application online. We request that applications not be submitted directly to this email address.