Senior Data Engineer

IBM Computing; Leicester; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading company is seeking a Senior Data Engineer to join their dynamic team, focusing on public sector accounts. This role involves designing and managing scalable data pipelines, ensuring data integrity, and collaborating with cross-functional teams to drive impactful solutions for government clients.

Benefits

Regular promotion opportunities

Diversity & Inclusion initiatives

Flexible working approaches

Paid maternity and paternity leave

Gym discount scheme

Employee Assistance Program

Qualifications

• Extensive experience as a Data Engineer or similar role, preferably within the public sector.
• Strong knowledge of Python and familiarity with Elasticsearch highly desirable.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes.
• Collaborate with data scientists and engineers to integrate complex data systems.
• Ensure data quality, accuracy, and reliability through testing and validation procedures.

Skills

Data Engineering

Analytical Skills

Problem Solving

Communication

Education

Bachelor's degree in Computer Science

Tools

Java

Python

Elasticsearch

SQL

Job description

Introduction

In this role, you'll work in one of our IBM Consulting Client Innovation Centres (Delivery Centres), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centres offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio, including Software and Red Hat.

Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you'll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in ground-breaking impact for a wide network of clients. Our culture of evolution and empathy centres on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.

We offer:

• Regular and frequent promotion and progression opportunities to ensure you can drive and develop your career with us

• Feedback and checkpoints throughout the year; no one off annual reviews here

• A multitude of training opportunities from classroom to e-learning, mentoring and coaching programs as well as the chance to gain industry recognized certifications

• Diversity & Inclusion as an essential and authentic component of our culture through our policies and process as well as our Employee Champion teams and support networks

• A culture where your ideas for growth and innovation are always welcome

• Internal recognition programs for peer-to-peer appreciation as well as from manager to employees

• Tools and policies to support your work-life balance from flexible working approaches, sabbatical programs, 1 month paid paternity leave, 16 weeks fully paid maternity leave and an innovative maternity returners scheme

• More traditional benefits, such as 25 days holiday, a gym discount scheme, online shopping discounts, an Employee Assistance Program, a group personal pension plan of an additional 5% of your base salary paid by us monthly to save for your future.

Your role and responsibilities

IBM is seeking a skilled Senior Data Engineer to join our dynamic team, focusing on public sector accounts. This role offers an exciting opportunity to leverage your expertise in data engineering to drive impactful solutions for government clients.

The Senior Data Engineer will be responsible for designing, developing, and managing scalable data pipelines, integrating heterogeneous systems, and implementing robust data models. The ideal candidate will collaborate with cross-functional teams to ensure data integrity, security, and availability, while meeting regulatory requirements specific to the public sector.

Required technical and professional expertise

Responsibilities:

• Design, build, and maintain scalable data pipelines and ETL processes.

• Collaborate with data scientists and engineers to integrate complex data systems.

• Ensure data quality, accuracy, and reliability through testing and validation procedures.

• Develop and implement data storage solutions, including data modeling and schema design.

• Provide technical support and guidance for data-related issues.

• Stay current with industry trends and emerging technologies to continually enhance data solutions.

• Bachelor's degree in Computer Science, Information Systems, or related field; advanced degree preferred.

• Extensive experience as a Data Engineer or similar role, preferably within the public sector.

• Proficiency in Java (Programming Language)

• Strong knowledge of Python (Programming Language) - Highly desirable.

• Familiarity with Elasticsearch (Search/Storage Technology) - Highly desirable.

• Comprehensive understanding of SQL (Search Query Language for relational databases).

• General Data Engineering skills

• Basic understanding of symmetric key cryptography

• Basic understanding of common file formats and serialization techniques.

• Strong analytical and problem-solving skills.

• Excellent communication and team collaboration abilities.

As an equal opportunities’ employer, we welcome applications from individuals of all backgrounds. However, for you to be eligible for this role, you must have the valid right to work in the UK. Unfortunately, we do not offer visa sponsorship and have no future plans to do so. You must be a resident in the UK and have been living continuously in the UK for the last 10 years. You must be able to hold or gain a UK government security clearance.

Preferred technical and professional experience

Preferred Skills:

• Experience working within the public sector.

• Knowledge of cloud platforms (e.g., IBM Cloud, AWS, Azure).

• Familiarity with big data processing frameworks (e.g., Apache Spark, Hadoop).

• Understanding of data warehousing concepts and experience with tools like IBM Cognos or Tableau.

Certifications:While not required, the following certifications would be highly beneficial:

• Experience working within the public sector.

• Knowledge of cloud platforms (e.g., IBM Cloud, AWS, Azure).

• Familiarity with big data processing frameworks (e.g., Apache Spark, Hadoop).

• Understanding of data warehousing concepts and experience with tools like IBM Cognos or Tableau.

IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.