Senior Databricks & AI Architect

ALOIS UK; Perth; Presencial; AUD 180 000 - 260 000; Tempo integral

Resumo da oferta

ALOIS Australia is seeking a visionary Senior Databricks & AI Architect to lead the evolution of our data platform and AI roadmap. You will bridge insurance data domains with advanced AI execution, designing scalable Spark-based architectures and implementing FinOps and optimisation strategies.

You will own governance, data modelling, and AI workflows, including multi-agent systems, LangChain/LlamaIndex orchestration, and regulatory document handling, while ensuring security compliance with

Qualificações

• 8+ years in Data Engineering/Architecture with leadership
• 3+ years hands-on leadership in the Databricks ecosystem
• Expert Spark, Delta Lake, Databricks SQL proficiency
• Proven AI/ML solution design and deployment experience
• FinOps: cost management, instance selection, performance tuning
• Strong data modelling and reusable ETL/ELT templates
• Insurance/FinServ sector experience is preferred

Responsabilidades

• Architect and govern end-to-end data architectures on the Databricks platform
• Design AI workflows including Agentic AI, multi-agent systems
• Drive Databricks FinOps, cost-attribution, and performance tuning
• Standardise data templates and robust data modelling
• Translate insurance concepts into scalable data schemas and AI logic
• Ensure governance and security using Unity Catalog

Conhecimentos

Spark PySpark/Scala

Delta Lake

Databricks SQL

AI/ML

FinOps

Data modelling

Insurance domain

Formação académica

Bachelor/Master in CS/DS

Databricks Data Engineer Pro

Databricks ML Pro

Descrição da oferta de emprego

About Us

ALOIS Australia is a leading Talent and Technology Solutions company, focused on helping businesses across the country build stronger teams, smarter processes, and sustainable growth.

About Us

ALOIS Australia is a leading Talent and Technology Solutions company, focused on helping businesses across the country build stronger teams, smarter processes, and sustainable growth.

We work with organisations in diverse industries to deliver integrated workforce and technology solutions, from innovative hiring strategies to end‑to‑end digital transformation. Our approach combines data, insight, and human expertise to help clients solve complex workforce challenges with clarity and confidence.

Through our deep industry experience and commitment to excellence, we provide scalable, high‑performance solutions that deliver measurable impact. Whether it’s onshore project delivery, workforce optimisation, or specialised technology services, ALOIS Australia ensures results that truly make a difference.

From Sydney to Perth and everywhere in between, we’re driven by one purpose: to empower Australian businesses and professionals to thrive in a rapidly changing world of work. At ALOIS Australia, every challenge is an opportunity to innovate, and every partnership is built on trust, transparency, and long‑term success.

Job Title –Senior Databricks & AI Architect

Job Location – Sydney

Employment Type – Contract/FTC

Position Overview

What role you will play in Team:

We are seeking a visionary Senior Databricks & AI Architect to lead the evolution of our modern data platform and AI roadmap. In this role, you will bridge the gap between complex insurance data domains and cutting‑edge AI execution. You will be responsible for designing scalable Spark‑based architectures, implementing rigorous FinOps and optimisation strategies, and pioneering Agentic AI workflows to automate high‑value insurance processes (e.g., claims, underwriting, and risk assessment).

Key Responsibilities

• Architectural Leadership: Design and govern end‑to‑end data architectures on the Databricks Data Intelligence Platform, ensuring seamless integration with existing insurance ecosystems.
• AI Innovation: Lead the design of emerging AI workflows, specifically focusing on Agentic AI (multi‑agent systems), LLM orchestration (LangChain/LlamaIndex), and RAG patterns tailored for insurance policy and regulatory documents.
• Databricks FinOps & Performance: Own the platform’s efficiency. Implement cluster policies, Photon engine optimisations, and cost‑attribution models to ensure high performance with a focus on ROI.
• Data Engineering Excellence: Standardise data engineering templates (Medallion architecture) and implement robust data modelling (Star/Snowflake, Vault 2.0) to handle structured and unstructured insurance data.
• Domain Alignment: Translate complex insurance concepts (Premiums, Claims, Actuarial models) into scalable technical schemas and AI logic.
• Governance & Security: Ensure all designs comply with industry regulations using Databricks Unity Catalog.

Required Skills & Experience

• Experience: 8+ years in Data Engineering/Architecture, with at least 3+ years of hands‑on leadership within the Databricks ecosystem.
• Core Tech: Expert‑level knowledge of the Spark framework (PySpark/Scala), Delta Lake, and Databricks SQL.
• AI/ML Expertise: Proven experience building and deploying AI solutions. Deep understanding of the Agentic AI landscape—moving beyond simple chatbots to autonomous, goal‑oriented agents.
• FinOps Mastery: Specific experience in Databricks cost management, instance selection, and performance tuning (Z‑Ordering, Liquid Clustering).
• Data Management: Strong background in data modelling and the creation of reusable ETL/ELT templates and frameworks.
• Insurance Domain: Prior experience in the Insurance or FinServ sector is highly preferred; you must understand the nuances of policy‑centric data.

Education & Certifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
• Preferred: Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional.

Stay Connected With Us

Learn more about ALOIS in Australia, visit our webpage ALOIS Australia

Follow us on LinkedIn and Instagram

EEO Statement

ALOIS Australia is committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all qualified applicants and do not discriminate on the basis of race, colour, religion, sex, age, national origin, disability, or any other characteristic protected under applicable laws. We value diversity and believe it strengthens our people, our culture, and the outcomes we deliver.