Data Engineer - Advanced Analytics | Active eSC/eDV Required

IBM; Abbots Worthy; On-site; GBP 75,000 - 110,000; Full time

Benefits offered by this job

25 days holiday

Private medical coverage

Dental & Optical cover

Employee Assistance Program

Life assurance

Group pension plan

Job summary

IBM Consulting UK FutureNow is seeking a senior data engineer to design, build, and optimise data pipelines for analytics, ML, and AI workloads across enterprise environments. You will develop scalable data solutions and collaborate with data scientists, AI engineers, and architects to deliver impactful data products.

You will mentor juniors, contribute to governance, and stay current with cloud data platforms and modern processing frameworks to support AI initiatives across regulated industries.

Qualifications

• Extensive experience designing and building data engineering solutions in enterprise environments.
• Strong Python and SQL skills with modern data processing libraries.
• Experience with cloud-based analytics and data platforms (AWS/Azure/GCP).
• Proficiency in data modelling, quality, and governance principles.
• Excellent communication and stakeholder management in Agile contexts.

Responsibilities

• Design, build, and optimise data pipelines supporting analytics, ML, and AI workloads.
• Develop scalable data solutions across structured and unstructured data environments.
• Engineer datasets and analytical products enabling Data Science, AI, reporting, and decisions.
• Build and maintain data processing frameworks, transformation pipelines, and integrations.
• Collaborate with Architects, Data Scientists, AI Engineers, and stakeholders throughout delivery.
• Translate business requirements into scalable, maintainable technical solutions.
• Contribute to modern data platform design, governance, and engineering best practices.
• Mentor junior practitioners and help grow team capability.
• Continuously explore emerging data/AI technologies and approaches.

Skills

Python

SQL

Pandas

NumPy

PySpark

Dask

Spark

ETL/ELT pipelines

Cloud platforms

Databricks

Snowflake

Synapse

Data governance

Data modelling

Stakeholder management

Agile

Tools

Databricks

Microsoft Fabric

Snowflake

Synapse

Spark

PySpark

Dask

Job description

• Design, build, and optimise data pipelines supporting analytics, machine learning, and AI workloads.
• Develop scalable data solutions across structured and unstructured data environments.
• Engineer datasets and analytical products that enable Data Science, AI, reporting, and operational decision-making.
• Build and maintain data processing frameworks, transformation pipelines, and integration patterns.
• Support advanced analytics, predictive modelling, and AI initiatives through high-quality data engineering.
• Collaborate with Architects, Data Scientists, AI Engineers, and business stakeholders throughout the delivery lifecycle.
• Translate business requirements into scalable and maintainable technical solutions.
• Contribute to modern data platform design, data governance, and engineering best practices.
• Mentor junior practitioners and help develop team capability.
• Continuously explore emerging technologies and approaches across Data Engineering, Analytics, and AI.
  Strong experience designing and building data engineering solutions within enterprise environments.
• Proficiency in Python and SQL.
• Experience working with modern data processing libraries and frameworks such as:
• Pandas
• NumPy
• PySpark
• Dask
• Experience developing ETL / ELT pipelines and data transformation solutions.
• Exposure to analytics, machine learning, or AI-enabled data workloads.
• Experience working with cloud-based analytics and data platforms.
• Strong understanding of data modelling, data quality, and data governance principles.
• Excellent communication and stakeholder management skills.
• Experience working within Agile delivery environments.
• Ability to translate business requirements into scalable technical solutions.
• Preferred technical and professional experience
• Experience with modern data platforms such as:
  • Databricks
  • Microsoft Fabric
  • Snowflake
  • Synapse
• Exposure to machine learning, AI, or Generative AI delivery.
• Experience supporting predictive analytics, recommendation systems, or AI-enabled products.
• Familiarity with cloud services across AWS, Azure, or GCP.
• Experience working with Spark, distributed data processing, or large-scale analytics platforms.
• Experience delivering solutions within Public Sector, Defence, Financial Services, or other regulated environments.
• Consulting experience or exposure to client-facing delivery.
• Experience mentoring junior engineers or leading technical workstreams.

This role is subject to pre-employment screening in line with the UK Government's Baseline Personnel Security Standard (BPSS). Additional National Security Vetting (NSV) requirements may apply, including Security Check (SC) or Developed Vetting (DV).

IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

At IBM Consulting UK FutureNow, you'll build a career at the forefront of hybrid cloud and AI, working with leading clients across the public and private sectors. You'll collaborate with top industry professionals, gain hands on experience with cutting edge technologies, and deliver solutions that create real business impact. From day one, you'll work on meaningful, high profile programmes that stretch your skills and accelerate your growth. We invest heavily in you--supporting continuous learning, in demand skills development, and long term career progression. You'll thrive in a flexible, inclusive environment that values curiosity, encourages reinvention, and recognises what makes you unique. Working within IBM Consulting's Hybrid Cloud & Data practice, you'll design and deliver modern data solutions that support advanced analytics, machine learning, artificial intelligence, and Generative AI use cases across Public Sector, Financial Services, Defence, and other regulated industries. You'll collaborate with Data Scientists, AI Engineers, Architects, Product Owners, and stakeholders to build scalable data products and analytical solutions that solve real business challenges.

• Tools and policies to support your work-life balance from flexible working approaches, sabbatical programs, paid paternity leave, maternity leave and an innovative maternity returners scheme
• More traditional benefits, such as 25 days holiday (in addition to public holidays), private medical, dental & optical cover, online shopping discounts, an Employee Assistance Program, life assurance and a group pension plan through salary sacrifice.