Senior AI Data Engineer

Version 1; Roebuck; Remote; EUR 95,000 - 135,000; Full time

Benefits offered by this job

Profit Share Scheme

Career Development & Mentorship

Flexible/remote working

Pension & Private Healthcare

Job summary

Version 1 is seeking a Senior AI Data Engineer to design and implement modern data platforms and Generative AI workflows using Databricks and Azure.

You will build production-grade AI pipelines, RAG solutions, and multi-agent workflows, while mentoring teams and ensuring governance and MLOps capabilities within a complex enterprise environment.

Qualifications

• Hands-on experience building production-grade AI pipelines.
• Strong data engineering background with Databricks.
• Proficient in Python and SQL; experienced in ML workflows.

Responsibilities

• Design and build scalable ETL/ELT and AI pipelines.
• Develop and deploy Generative AI and agent-based solutions.
• Create and maintain RAG pipelines and AI training datasets.
• Mentor engineering teams in AI technologies and practices.

Skills

Databricks

PySpark

Python

SQL

MLflow

Unity Catalog

Azure

Delta Lake

Git

PyTorch

TensorFlow

Tools

Databricks Workflows

Azure Databricks

Job description

• Department: Public Sector & Utilities (Ireland)

Company Description

Version 1 has celebrated30 yearsinbusinessand continues to be trusted by global brands to delivertechnology and transformationsolutions that drive customer success. Ourdeepexpertiseenables our customers to navigate the rapidlyevolving technology landscape. We foster strong partnerships withglobal technology leadersincluding Microsoft, AWS, Oracle, Red Hat,OutSystems, Snowflake, ensuring that our customers are provided with the highest quality solutions and services.

We’rean award-winning employer reflecting how our employees are at the very heartof whatwe do:

• 10+ years as a Great Place to Work in Ireland & UK
• Best Workplace for Women in the UK & Ireland by GPTW
• Best Workplace for Wellbeing in the UK by GPTW

We’rea corevalues drivencompany, we hire people who share our values, and we reward those who display and foster them,it’sdeeply embedded within our DNA. Invest in us andwe’llinvest in you!.

Job Description

Overview

We are seeking an experienced SeniorAI Data Engineer to join a high-impact team delivering innovative data and AI solutions within a complex enterprise environment. This role will be responsible for designing and implementing modern data platforms, AI workflows, and Generative AI solutions using Databricks and Azure technologies.

The successful candidate will combine strong data engineering expertise with hands‑on experience building production‑grade AI solutions, including Retrieval Augmented Generation (RAG) pipelines, multi‑agent workflows, and MLOps capabilities.

Key Responsibilities

• Design and build scalable ETL/ELT and AI pipelines using Databricks, PySpark, Delta Lake and SQL.
• Develop and maintain Lakehouse architectures using Bronze, Silver and Gold data layers.
• Build and optimise Delta Live Tables, Databricks Workflows and job orchestration processes.
• Develop and deploy production‑grade Generative AI and agent‑based solutions.
• Create and maintain RAG pipelines and AI agent frameworks.
• Support MLOps activities, including model training and inference pipelines using MLflow.
• Implement data quality monitoring, governance controls and metadata management through Unity Catalog.
• Develop event‑driven integrations using Azure cloud services.
• Collaborate with cross‑functional teams to create feature stores and AI training datasets.
• Integrate Databricks with wider Azure services including ADLS Gen2, Azure Data Factory, Azure Key Vault and Azure DevOps.
• Contribute to the development of data engineering best practices and centre of excellence initiatives.
• Mentor and support engineering teams in AI technologies and capabilities.

Qualifications

• Strong experience as a Data Engineer, AI Engineer, Machine Learning Engineer, or similar role.
• Hands‑on experience building and deploying production‑grade:
  • Multi‑agent AI workflows
  • Retrieval Augmented Generation (RAG) solutions
  • AI agent frameworks
  • Data pipeline solutions within Databricks
• Strong programming skills in Python and SQL.
• Experience with Apache Spark and distributed data processing.
• Experience implementing Generative AI solutions within Databricks Workflows and Jobs.
• Strong knowledge of Databricks Lakehouse architecture.
• Hands‑on experience with:
  • Delta Lake
  • Unity Catalog
  • Databricks Workflows
  • MLflow
• Experience implementing event‑driven integrations using:
  • Azure Service Bus (essential)
  • Azure Functions (essential)
  • Azure Databricks (essential)
• Understanding of data modelling and Medallion/Lakehouse architecture.
• Experience with Git-based version control and CI/CD practices.
• Strong understanding of AI/ML pipelines, including data preparation, feature engineering and model deployment.
• Experience with PyTorch and/or TensorFlow.
• Experience with Event Hub and Logic Apps.
• Experience mentoring engineering teams or leading technical initiatives.
• Exposure to financial services or highly regulated environments.
• Experience building advanced LLMOps capabilities including prompt tracking, trace logging and regression benchmarking.
• Databricks
• PySpark
• Unity Catalog
• MLflow
• Python
• SQL
• Git
• PyTorch / TensorFlow

What We're Looking For

We are looking for an engineer who can bridge the gap between modern data engineering and AI innovation. You should be comfortable delivering production‑ready solutions, collaborating across teams, and enabling organisations to scale their AI capabilities through robust engineering practices.

Additional Information

Why Version 1?

At Version 1, we believe in providing our employees with a comprehensive benefits package that prioritises their wellbeing, professional growth, and financial stability.

• Share in our success with our Quarterly Performance-Related Profit Share Scheme, where employees collectively benefit from a share of our company's profits
• Strong Career Progression & mentorship coaching through our Strength in Balance & Leadership schemes with a dedicated quarterly Pathways Career Development programme
• Flexible/remote working, Version 1 is tremendously understanding of life events and people’s individual circumstances and offer flexibility to help achieve a healthy work life balance
• Financial Wellbeing initiatives including Pension, Private Healthcare Cover, Life Assurance, Financial advice and an Employee Discount scheme
• Employee Wellbeing schemes including Gym Discounts, Bike to Work, Fitness classes, Mindfulness Workshops, Employee Assistance Programme and much more. Generous holiday allowance, enhanced maternity/paternity leave, marriage/civil partnership leave and special leave policies
• Educational assistance, incentivised certifications, and accreditations, including AWS, Microsoft, Oracle, and Red Hat
• Environment, Social and Community First initiatives allow you to get involved in local fundraising and development opportunities as part of fostering our diversity, inclusion and belonging schemes.

Version1 is an equal opportunities employer.

We are committed to building a diverse,inclusiveand respectful workplace where everyone feels valued and able to thrive. We welcome applications from people of all backgrounds, identities and lived experiences, and we value the different perspectives people bring including those shaped by disability and neurodiversity.

We want every candidate to have a positive and accessible recruitment experience. If you need reasonable adjustments at any stage of the process, please contact your recruiter [e-mail] at Version 1. We will consider all requests carefully, respectfully and confidentially.