Databricks Engineer

axiscapital; Dublin; Hybrid; EUR 90,000 - 120,000; Full time

Job summary

AXIS Capital is seeking a Databricks Engineer to design, build and operate data integration and analytics solutions across Azure data services. You will collaborate with Solution Engineers and Data Architecture teams to translate designs into production-grade implementations, improving platform reliability and governance.

The role requires hands-on Databricks, Delta Lake, Spark, PySpark and SQL expertise, and welcomes collaboration with offshore teams and business stakeholders.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a numerate discipline.
• At least 5 years in data engineering roles with Databricks experience.
• Strong Azure data platform expertise and Spark/PySpark/SQL proficiency.
• Experience with Medallion/Lakehouse architectures and data governance.

Responsibilities

• Design, build and operate data integration and analytics solutions.
• Improve platform reliability, performance and cost efficiency on Databricks.
• Collaborate with Solution Engineers, Architects and offshore teams.
• Implement data contracts, RBAC/ABAC, and data quality controls.
• Contribute to engineering standards and platform modernization.

Skills

Databricks

Azure data platform

Spark

PySpark

SQL

CI/CD

IaC

MLOps

Communication

Data governance

Education

Bachelor's degree in CS/IT

Tools

Terraform

Bicep

ARM templates

Unity Catalog

Delta Lake

MLflow

Job description

This is your opportunity to join AXIS Capital - a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client service, intelligent risk taking and superior risk adjusted returns for our shareholders. We also proudly maintain an entrepreneurial, disciplined and ethical corporate culture. As a member of AXIS, you join a team that is among the best in the industry.

At AXIS, we believe that we are only as strong as our people. We strive to create an inclusive and welcoming culture where employees of all backgrounds and from all walks of life feel comfortable and empowered to be themselves. This means that we bring our whole selves to work.

All qualified applicants will receive consideration for employment without regard to any protected characteristic, including age, color, disability, ethnicity, gender identity, marital status, national origin, pregnancy, race, religion, sex, sexual orientation, veteran status, or any basis prohibited by the laws that govern its operations.

How does this role contribute to our collective success?

The Data & Analytics organization empowers AXIS to make informed, data‑driven decisions by delivering trusted, scalable, and well‑governed data platforms.

As a Databricks Engineer, you will work closely with the Solution Engineer and Data Architecture teams to design, build, and operate data integration and analytics solutions. You will play a key role in translating architectural designs and solution patterns into high‑quality, production‑ready implementations.

This role contributes to AXIS's success by strengthening delivery capacity, improving platform reliability, and ensuring data engineering best practices are consistently applied across squads - while being supported by senior architectural leadership.

What will you do in this role?

As a Databricks Engineer, you will be a hands‑on contributor and technical partner, supporting solution design and architecture initiatives led by the Solution Engineer, while owning implementation quality and operational excellence.

Key Responsibilities

• Data Integration & Ingestion Design and implement data integration solutions in collaboration with the Solution Engineer and data architects.
• Support ingestion, transformation, and orchestration using ADF, Synapse pipelines, Databricks Workflows, and event‑based patterns.
• Implement batch, incremental, and event‑driven ingestion using agreed reference architectures.
• Maintain and extend data integration frameworks.
• Data Modeling & Consumption Contribute to data modeling standards (Dimensional, Data Vault, Lakehouse).
• Implement analytics‑ready models and semantic layers for BI and ML.
• Apply agreed data contracts and integration patterns.
• Governance, Security & Compliance Implement data cataloging, lineage, and data quality controls.
• Apply RBAC, ABAC, encryption, and auditability controls.
• Performance & Operational Excellence Optimize Databricks performance, cost, and storage layout.
• Monitor and troubleshoot pipelines and workloads.
• Platform Evolution & Collaboration Support platform modernization, POCs, and migrations.
• Contribute to engineering standards and participate in design reviews.
• Partner with offshore teams, architects, and business stakeholders.
• You may also be required to take on additional duties, responsibilities and activities appropriate to the nature of this role.

About You

You are an experienced Databricks engineer who enjoys working on complex platforms, delivering high‑quality implementations while leveraging guidance from senior architectural leadership.

Role Factors

The position is full‑time with work‑from‑home options, requiring in‑office presence three (3) days per week.

Required Skills & Experience

• Bachelor's degree in Computer Science, Information Technology, or a numerate discipline.
• At least 5 years of experience in data engineering roles.
• At least 3 years of hands‑on Databricks and Delta Lake experience.
• Strong Azure data platform expertise (Databricks, ADF, Synapse, Event Hubs, Functions, ADLS Gen2, Key Vault, DevOps).
• Proficiency in Spark, PySpark, and SQL.
• Experience implementing Medallion / Lakehouse architectures.
• Familiarity with data governance, Unity Catalog, and DQ frameworks.
• Understanding of security, compliance, CI/CD, and IaC (Bicep/Terraform).
• MLOps and AI platform knowledge: MLflow, feature stores, model lifecycle and deployment patterns.
• Strong communication and collaboration skills.

Preferred Qualifications

• Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect).
• Experience with Terraform, ARM templates, or Bicep for infrastructure automation.
• Experience with GenAI, and using AI agents, use of Copilot, Claude, or similar models for automation or process optimization to reduce day to day manual work.
• Experience integrating Azure Data Services with Power BI and AI/ML workflows.