Allianz - Senior Databricks & AI Architect

Allianz PNB Life

Thiruvananthapuram

Sur place

INR 2 500 000 - 4 500 000

Plein temps

Il y a 3 jours
Soyez parmi les premiers à postuler

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

Allianz PNB Life seeks a visionary Senior Databricks & AI Architect to lead the evolution of its data platform and AI roadmap for insurance data. You will design scalable Spark-based architectures, implement FinOps, and pioneer Agentic AI workflows to automate key insurance processes.

You will bridge complex data domains with cutting-edge AI, ensuring regulatory compliance and high ROI through efficient platform governance and cost attribution.

Qualifications

  • 8+ years in Data Engineering/Architecture with leadership in the Databricks ecosystem.
  • Expert-level knowledge of Spark (PySpark/Scala), Delta Lake, and Databricks SQL.
  • Proven experience building and deploying AI solutions with Agentic AI knowledge.
  • Experience in Databricks cost management, instance selection, and performance tuning.
  • Strong background in data modelling and reusable ETL/ELT templates/frameworks.
  • Prior experience in Insurance or FinServ is highly preferred.

Responsabilités

  • Design and govern end-to-end data architectures on the Databricks Data Intelligence Platform, ensuring seamless integration with existing insurance ecosystems.
  • Lead the design of emerging AI workflows focusing on Agentic AI (multi-agent systems), LangChain/LlamaIndex, and RAG patterns for insurance policy and regulatory documents.
  • Own the platform's efficiency, implementing cluster policies, Photon engine optimisations, and cost-attribution models for ROI.
  • Standardise data engineering templates (Medallion architecture) and implement robust data modelling (Star/Snowflake, Vault 2.0).
  • Translate complex insurance concepts (Premiums, Claims, Actuarial models) into scalable technical schemas and AI logic.
  • Ensure all designs comply with industry regulations using Databricks Unity Catalog.

Connaissances

Databricks
Spark (PySpark/Scala)
Delta Lake
AI/Agentic AI
Cost management/FinOps
Data modelling
Insurance/FinServ domain knowledge

Formation

Bachelor's or Master's degree in Computer Science/Data Science

Outils

Databricks SQL
LangChain
LlamaIndex
Photon engine

Description du poste

Position Overview

We are seeking a visionary Senior Databricks & AI Architect to lead the evolution of our modern data platform and AI roadmap.

Position Overview

We are seeking a visionary Senior Databricks & AI Architect to lead the evolution of our modern data platform and AI roadmap. In this role, you will bridge the gap between complex insurance data domains and cutting‑edge AI execution. You will be responsible for designing scalable Spark-based architectures, implementing rigorous FinOps and optimisation strategies, and pioneering Agentic AI workflows to automate high-value insurance processes (e.g., claims, underwriting, and risk assessment).

Key Responsibilities
  • Design and govern end-to-end data architectures on the Databricks Data Intelligence Platform, ensuring seamless integration with existing insurance ecosystems.
  • Lead the design of emerging AI workflows, specifically focusing on Agentic AI (multi‑agent systems), LLM orchestration (LangChain/LlamaIndex), and RAG patterns tailored for insurance policy and regulatory documents.
  • Own the platform's efficiency, implementing cluster policies, Photon engine optimisations, and cost‑attribution models to ensure high performance with a focus on ROI.
  • Standardise data engineering templates (Medallion architecture) and implement robust data modelling (Star/Snowflake, Vault 2.0) to handle structured and unstructured insurance data.
  • Translate complex insurance concepts (Premiums, Claims, Actuarial models) into scalable technical schemas and AI logic.
  • Ensure all designs comply with industry regulations using Databricks Unity Catalog.
Required Skills & Experience
  • 8+ years in Data Engineering/Architecture, with at least 3+ years of hands‑on leadership within the Databricks ecosystem.
  • Expert‑level knowledge of the Spark framework (PySpark/Scala), Delta Lake, and Databricks SQL.
  • Proven experience building and deploying AI solutions, with a deep understanding of the Agentic AI landscape.
  • Specific experience in Databricks cost management, instance selection, and performance tuning (Z‑Ordering, Liquid Clustering).
  • Strong background in data modelling and the creation of reusable ETL/ELT templates and frameworks.
  • Prior experience in the Insurance or FinServ sector is highly preferred.
Education & Certifications
  • Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
  • Preferred: Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional.

(ref:hirist.tech)

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior Databricks & AI Architect_D3006
Senior Databricks & AI Architect_D3006

Allianz Technology • Thiruvananthapuram

Sur place
INR 5 000 000 - 9 000 000
Senior Databricks & AI Architect_D3006
Senior Databricks & AI Architect_D3006

Allianz • Pune

Sur place
INR 18 000 000 - 26 000 000
Senior Data engineer
Senior Data engineer

Ample Success HR • Inde

À distance
INR 2 500 000 - 4 000 000
Data Architect
Data Architect

Mphasis • Noida

Sur place
INR 4 500 000 - 7 500 000
Azure Databricks
Azure Databricks

Cognizant Technology Solutions Corporation • Chennai

Sur place
INR 3 000 000 - 6 000 000
Sr. Data / Data Solutions Architect - Databricks
Sr. Data / Data Solutions Architect - Databricks

EPAM Systems Inc • Hyderabad, Chennai District, Bengaluru

Sur place
INR 3 500 000 - 7 000 000
Senior Solution Architect - Data & AI
Senior Solution Architect - Data & AI

India Fan Corporation • Hyderabad

Hybride
INR 2 800 000 - 4 200 000
Senior Data Scientist
Senior Data Scientist

Bandhan Life Insurance Limited • Mumbai

Sur place
INR 2 200 000 - 4 000 000
Databricks Architect
Databricks Architect

Psyncopate • Chennai, Bengaluru

Hybride
INR 4 500 000 - 7 500 000
AI Architect
AI Architect

R3 Consultant • Dadri

Sur place
INR 2 000 000 - 3 000 000