Data Pipeline Engineer

Hexegic; Greater London; Hybrid; GBP 50,000 - 60,000; Full time

Benefits offered by this job

Professional development budget

Wellness program

25 days annual leave

Hybrid work arrangements

Job summary

Hexegic in the United Kingdom is seeking a Data Health Engineer to ensure data health across critical pipelines. You will be first to respond to failures, read code, and implement fixes to keep analytics tools reliable.

Working with Python and PySpark, you will set up health checks, triage incidents, and communicate outages to end users. This role offers hybrid working and a clear development budget. Eligible for UK security clearance is required.

Qualifications

• Reading and writing code in Python and PySpark.
• Understanding Spark and data pipeline concepts.
• Navigate pipeline development tools.

Responsibilities

• Maintain build schedules so pipelines run effectively.
• Set up and maintain health checks on data pipelines.
• Respond, triage and debug pipelines when broken.
• Read and modify code and monitoring setups.
• Communicate outages to end users.

Skills

Python

PySpark

Spark

Job description

You will ensure our customer works with updated and correct data in our data analytics tools by being the first to respond to data health failures on key pipelines, reading code and making changes.

About us

Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.

Core Responsibilities

• Maintain build schedules so that pipelines run effectively
• Set up and maintain health checks on data pipelines
• Respond, triage and debug the pipelines when broken
• Read and make changes to code, and modify monitoring set-ups
• Communicating outages to end users

What we are looking for

• Comfortable reading and writing code in Python, PySpark
• Basic understanding of Sparkli>
• Ability to navigate pipeline development tools

What’s in it for you?

• Base salary of £50,000-£60,000
• £5000 a year professional development budget
• Wellness program
• 25 days annual leave
• Hybrid working arrangements

Please note that successful candidates must be eligible for UK security clearance