Senior Data Engineering Consultant (Databricks)

Talan; Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Benefits offered by this job

BDP Plus sabbatical

Holiday allowance

Holiday buy/sell

Private medical insurance

Life cover

Cycle to work

Company pension

Employee assistance

Udemy for Business

Job summary

Talan Data x AI is seeking a Senior Data Engineering Consultant (Databricks) to design and deliver data pipelines, analytics solutions, and dashboards for diverse client engagements in the UK.

You will work with Databricks and PySpark, build and optimize data workflows, and publish dashboards using Power BI, Tableau, and cloud services. Travel to client sites and collaboration with stakeholders are key parts of the role.

Qualifications

• Multi-skilled experience across data management, engineering, warehousing, modelling, quality, integration, analytics, visualization, science.
• Proven Databricks experience and PySpark in Databricks environments.
• Experience building dashboards/reports with Power BI.
• Strong Python and SQL skills; write complex SQL queries.
• Experience with Tableau, Power BI, Cloud (Azure/AWS/GCP), Snowflake and their Databricks integration.
• Experience with data ingestion, transformation, and quality control.
• Excellent problem solving and the ability to think critically under pressure.
• Strong communication and stakeholder skills.
• Experience leading technical and/or project teams.
• Awareness of industry standards and DevOps practices.
• Project lifecycle experience; familiarity with Agile, Waterfall, Scrum, DevOps, Testing.
• Experience of DevOps and infrastructure deployments (Azure and Databricks).

Skills

Data Management

Data Engineering

Data Warehousing

Data Modelling

Data Quality

Data Integration

Data Analytics

Data Visualisation

Data Science

Business Intelligence

Databricks

Power BI

Tableau

Azure

AWS

GCP

Snowflake

Python

SQL

Tools

Databricks

Power BI

Tableau

Azure

AWS

GCP

Snowflake

Python

SQL

Job description

Senior Data Engineering Consultant (Databricks)

Senior Data Engineering Consultant (Databricks)

• Strong team player with the ability to work independently


• Excellent client‑facing and stakeholder engagement skills


• Proactive, self‑motivated, and adaptable


• Strong verbal, written, and presentation skills


• Ability to build effective internal and external relationships


• Strong influencing and negotiation skills


• Creative thinker with the ability to propose innovative solutions


• Passion for continuous learning and self‑development


• Leadership capability, either formally or through delivery ownership

To qualify for this role, you must have:

• Multi-skilled experience in one or more of the following disciplines: Data Management, Data Engineering, Data Warehousing, Data Modelling, Data Quality, Data Integration, Data Analytics, Data Visualisation, Data Science and Business Intelligence.


• Confident in delivering solutions using Databricks & developing and optimising data pipelines using PySpark within Databricks environments.


• Proven experience building, publishing, and supporting dashboards and reports using Power BI


• Strong experience and programming skills in languages such as Python and SQL and the ability to write complex SQL queries.


• Project experience using one or more of the following technologies: Tableau, Power BI, Cloud, Azure, AWS, GCP, Snowflake) and their integration with Databricks.


• Experience with data ingestion, transformation, and quality control processes.


• Excellent problem-solving skills and the ability to think critically under pressure.


• Strong communication and interpersonal skills, with the ability to work effectively with clients and stakeholders.


• Experience of leading technical and/or project teams.


• A proactive awareness of industry standards, regulations, and developments.


• Project lifecycle experience, having played a leading role in the delivery of end-to-end projects, as well as a familiarity with different development methodologies and disciplines (e.g. Agile, Waterfall Scrum, DevOps, Testing).


• Experience of DevOps and infrastructure deployments (Azure and Databricks).

Ideally, you’ll also have:

• Delivery experience using the following technology: SAS (SAS EG, SAS DI, SAS Viya).


• Relational Databases and Data Warehousing concepts.


• Enterprise ETL tools such as Informatica, Talend, Datastage or Alteryx.


• Project experience using the any of the following technologies: Hadoop, Spark, Scala, Oracle, Pega, Salesforce.


• Cross and multi-platform experience.


• Team building and leading.

Qualifications

You must be:

• Willing to work on client sites, potentially for extended periods.


• Willing to travel for work purposes and be happy to stay away from home for extended periods.


• Eligible to work in the UK without restriction.

Additional Information

What we offer:

• BDP Plus – A reward programme whereby you accrue points to trade against a 3-month paid sabbatical or cash equivalent.


• 25 days holiday + bank holidays.


• 5 days holiday buy/sell option.


• Private medical insurance.


• Life cover.


• Cycle to work scheme.


• Eligibility for company pension scheme (5% employer contribution, salary sacrifice option).


• Employee assistance programme.


• Bespoke online learning via Udemy for Business.

Company Description

Talan Data x AI is a leading Data Management and Analytics consultancy, working closely with leading software vendors and top industry experts across a range of sectors, unlocking value and insight from their data. At Talan Data x AI, innovation is at the heart of our client offerings, and we help companies to further improve their efficiency with modern processes and technologies, such as Machine Learning (ML) and Artificial Intelligence (AI).

Our consultants are at the heart of everything we do, and we have been recertified as a 2025 Great Place to Work®. This achievement not only highlights Talan Data x AI’s positive organisational culture but also strengthens its reputation as an employer of choice within the industry. We invest heavily in the training and development of our teams and hold regular socials in each region to encourage engagement and network building.

Senior Data Engineering Consultant (Databricks)