Data Engineer

Times Higher Education; London; Hybrid; GBP 60,000 - 65,000; Full time

Job summary

A leading company in the education sector seeks a hands-on Data Engineer to support data delivery processes in a hybrid work environment. This role involves ensuring data pipeline reliability, managing data governance, and collaborating with cross-functional teams to enhance data delivery mechanisms. Ideal candidates will have robust experience in SQL and data management, as well as strong problem-solving and communication skills.

Qualifications

• Experience in building end-to-end data pipelines.
• Proficiency in SQL/PostgreSQL and AWS.
• Strong communication and problem-solving skills required.

Responsibilities

• Support data delivery team in data collection and processes.
• Manage data governance and ensure data pipeline efficiency.
• Collaborate with teams on data management and documentation.

Skills

SQL

PostgreSQL

Mongo

DataBricks

AWS

Data governance

Data analysis

Structured thinking

Problem-solving

Communication skills

Collaboration

Investigative mindset

Job description

Report to: Director of Data Science

Location: Hybrid (2 days/week in office, London Holborn)

Salary: 60-65k DOE

About Us

The data team at Times Higher Education works with real-world data inputs from a number of external sources, and our work is reliant on this data being easily accessible; the results of our analyses also need to be shared across the company and to external parties, for a growing number of applications.

Your role will be focused on supporting the delivery of data to our various internal stakeholders, within and outside the data team.

You will work closely with our Dir. Of Data Science, Data Scientists and Product Owners to ensure our data pipelines are reliable and scalable.

This is a role that will suit a hands-on data engineer (or data analyst/scientist with strong data engineering skills), who can work on ad-hoc data delivery as well as help strengthen our whole pipeline and governance, providing expert input and support to the team.

Responsibilities

• Support Data Delivery team in data collection and provision processes
• Support Consultancy team in accessing data outputs in a replicable way
• Data governance of our internal reference data, including monitoring data feeds and changes
• Support Data QA manager in running QA processes on external inputs
• Work with Engineering and Product team to build consistent and reliable data delivery mechanisms to our various products
• Work with Dirs. of Data Science and Data Delivery to optimise data processes and improve interoperability
• Strengthen and help scale our existing ETL pipelines, with a focus on flexible and adaptable delivery mechanisms
• Work with Data Governance Manager to monitor, maintain and utilise our internal university database
• Work with our Engineering team on our data collection platform, ensuring efficient and accurate data entry and flows
• Maintain documentation of our data storage and processes, sharing knowledge and access across the company

Experience

• Building end-to-end data pipelines (data collection, processing and delivery)
• Improving, maintaining and managing existing pipelines, incl. building and disseminating documentation
• Working with external data
• Data provision to (data) product
• Data governance
• Building scalable and robust data flows

Skills

Technical:

• SQL / PostgreSQL
• Mongo
• DataBricks
• AWS
• Data governance and management
• An interest in data analysis and a close management of data flows (very hands-on processes, data exploration)

Non-technical:

• Structured thinking and approach to problem-solving
• Excellent written and verbal communication skills; able to provide succinct and precise summaries of complex processes
• Highly collaborative, able to work efficiently with technical and non-technical colleagues, proactive in providing information and moving projects ahead
• An investigative mindset, keen to understand the data in-depth and resolve complex issues
• An ability to organise and drive projects without close ticket-type management

Desirable

• Python
• API build and management
• GDPR and regulatory frameworks
• Data QA