Senior Data Architect_D3006

Allianz; India; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Allianz Group is seeking a Senior Databricks & AI Architect to lead data platform evolution and AI roadmap across insurance domains. The role designs scalable Spark-based architectures, implements FinOps, and pioneers agentic AI workflows for claims, underwriting, and risk assessment.

Requires 8+ years in data engineering/architecture with 3+ years in leadership within Databricks, deep Spark/Delta Lake expertise, and insurance domain familiarity. Databricks certifications preferred.

Qualifications

• 8+ years in data engineering/architecture with leadership within Databricks.
• Deep Spark (PySpark/Scala), Delta Lake, and Databricks SQL experience.
• Insurance/FinServ domain experience preferred.

Responsibilities

• Architect end-to-end data architectures on the Databricks platform.
• Design AI workflows with agentic AI and LLM orchestration.
• Implement FinOps & performance tuning (Z-Ordering, clustering).
• Standardise data templates and robust data modelling.
• Translate insurance concepts into scalable AI schemas.
• Ensure governance and security with Unity Catalog.

Skills

Spark (PySpark/Scala)

Delta Lake

Databricks SQL

AI/ML solutions

Agentic AI

FinOps

Data modelling

Leadership

Education

Bachelor’s degree in Computer Science or Data Science

Master’s degree in Computer Science or Data Science

Databricks Certified Data Engineer Professional

Databricks Certified Machine Learning Professional

Tools

Databricks

Photon engine

Z-Ordering

Liquid Clustering

LangChain

LlamaIndex

Job description

Position Overview

We are seeking a visionarySenior Databricks & AI Architectto lead the evolution of our modern data platform and AI roadmap. In this role, you will bridge the gap between complex insurance data domains and cutting‑edge AI execution. You will be responsible for designing scalable Spark-based architectures, implementing rigorous FinOps and optimisation strategies, and pioneeringAgentic AIworkflows to automate high-value insurance processes (e.g., claims, underwriting, and risk assessment).

Key Responsibilities

• Architectural Leadership:Design and govern end-to-end data architectures on theDatabricks Data Intelligence Platform, ensuring seamless integration with existing insurance ecosystems.
• AI Innovation:Lead the design of emerging AI workflows, specifically focusing onAgentic AI(multi-agent systems), LLM orchestration (LangChain/LlamaIndex), and RAG patterns tailored for insurance policy and regulatory documents.
• Databricks FinOps & Performance:Own the platform’s efficiency. Implement cluster policies, Photon engine optimisations, and cost‑attribution models to ensure high performance with a focus on ROI.
• Data Engineering Excellence:Standardise data engineering templates (Medallion architecture) and implement robust data modelling (Star/Snowflake, Vault 2.0) to handle structured and unstructured insurance data.
• Domain Alignment:Translate complex insurance concepts (Premiums, Claims, Actuarial models) into scalable technical schemas and AI logic.
• Governance & Security:Ensure all designs comply with industry regulations using DatabricksUnity Catalog.

Required Skills & Experience

• Experience:8+ years in Data Engineering/Architecture, with at least 3+ years of hands‑on leadership within theDatabricksecosystem.
• Core Tech:Expert‑level knowledge of theSpark framework(PySpark/Scala), Delta Lake, and Databricks SQL.
• AI/ML Expertise:Proven experience building and deploying AI solutions. Deep understanding of theAgentic AIlandscape—moving beyond simple chatbots to autonomous, goal‑oriented agents.
• FinOps Mastery:Specific experience in Databricks cost management, instance selection, and performance tuning (Z‑Ordering, Liquid Clustering).
• Data Management:Strong background in data modelling and the creation of reusable ETL/ELT templates and frameworks.
• Insurance Domain:Prior experience in the Insurance or FinServ sector is highly preferred; you must understand the nuances of policy‑centric data.

Education & Certifications

• Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
• Preferred:Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional.

Allianz Group is one of the most trusted insurance and asset management companies in the world. Caring for our employees, their ambitions, dreams and challenges, is what makes us a unique employer. Together we can build an environment where everyone feels empowered and has the confidence to explore, to grow and to shape a better future for our customers and the world around us.

At Allianz, we stand for unity: we believe that a united world is a more prosperous world, and we are dedicated to consistently advocating for equal opportunities for all. And the foundation for this is our inclusive workplace, where people and performance both matter, and nurtures a culture grounded in integrity, fairness, inclusion and trust.

We therefore welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, social class, disability or sexual orientation, or any other characteristics protected under applicable local laws and regulations.

Join us . Let’s care for tomorrow.