Databricks Data & AI Engineer — AI‑Ready Pipelines

Aiimi; Milton Keynes; Hybrid; GBP 70,000 - 110,000; Full time

Benefits offered by this job

25 days annual leave

Flexible working options – hybrid

Mental health and wellbeing support

Annual wellbeing allowance

Up to 10% of salary in employee perks

Generous pension contribution

Ongoing professional development

Job summary

Aiimi is a British technology and services company focused on turning enterprise data into trusted assets. We seek a Data & AI Engineer to help clients build trusted data products and evaluate AI-enabled solutions, centred on Databricks.

You’ll develop data foundations and test ideas using Databricks features, collaborating with clients and colleagues to turn business problems into practical data-driven solutions.

Qualifications

• Design and build data pipelines and transformations.
• Strong Python and SQL skills with PySpark experience.
• Hands-on Databricks experience and Delta Lake.
• Experience with lakehouse architectures.
• Generative AI knowledge and practical evaluation.
• Ability to build and assess prototypes for clients.
• Clear communication with non-specialists.

Responsibilities

• Design and build data pipelines and transformations on Databricks using Python, SQL and PySpark.
• Develop reliable data foundations for analytics and AI, using Spark and Delta Lake.
• Explore Databricks capabilities such as Apps and Genie for real business needs.
• Build prototypes combining data with Databricks features.
• Work with business users to identify questions and workflows.
• Evaluate prototypes with realistic data and explain results.
• Assess data quality, structure, metadata and access implications.
• Recommend next steps for promising ideas including data/engineering work.
• Apply strong engineering practices for maintainable prototypes.
• Explain findings to clients and share reusable patterns.

Skills

Data engineering

Python

SQL

PySpark

Databricks

Delta Lake

Generative AI

Technical judgement

Communication

Tools

Databricks Apps

Genie

Azure

Job description

Aiimi is a British technology and services company focused on turning enterprise data into trusted assets. We seek a Data & AI Engineer to help clients build trusted data products and evaluate AI-enabled solutions, centred on Databricks.

You’ll develop data foundations and test ideas using Databricks features, collaborating with clients and colleagues to turn business problems into practical data-driven solutions.