Senior Data Engineer

Remitly; Greater London; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Pension plan

Generous vacation

Healthcare benefits

Remote onboarding

Employee discounts

Employee assistance program

Job summary

Elsevier is seeking a Senior Data Engineer to design, build, and run scalable data pipelines for large-scale search and analytics use cases. You will work hands-on and mentor other engineers while shaping data platforms used by Scopus, ScienceDirect, and AI-driven solutions.

Requirements include strong Python and Java, Spark, Airflow, SQL, and experience with AWS; familiarity with data lakes and distributed systems is important for success.

Qualifications

• Experience designing and operating production data pipelines.
• Strong Python and at least one backend language (Java).
• Understanding data lakes, batch processing, and distributed systems.

Responsibilities

• Design, build, and maintain scalable data pipelines and services.
• Develop batch and ELT/ETL workflows for large datasets.
• Work with Python, Java, Spark, SQL, and Airflow.
• Apply software engineering practices, including testing and CI/CD.
• Contribute to cloud-based systems (AWS) focusing on reliability and monitoring.
• Collaborate with product, platform, and data science teams.
• Support learning through code reviews and knowledge sharing.

Skills

Python

Java

Spark

Airflow

AWS

Data Lakes

Distributed Systems

Production Monitoring

Communication

Tools

SQL

Job description

Senior Data Engineer

Are you passionate about building scalable, high-performance data-driven applications?
Do you enjoy turning complex datasets into robust, reliable systems that deliver real business impact?

Aboutthe team:

The Search and AI Platform supports core products such as Scopus, ScienceDirect, and AI‑driven research solutions. As a Senior Data Engineer, you will help design, build, and run reliable data pipelines and services that support large‑scale search and analytics use cases. You will work hands‑on while also supporting and guiding other engineers.

Aboutthe role:

The Search and AI Platform is Elsevier’s agentic data platform, which powers products such as Scopus, ScienceDirect, and our next-generation LLM-powered research systems. The platform utilises agentic services to interrogate our rich knowledge graphs, search and recommendation systems, and our unparalleled collection of research data, delivering insights to the scientific community that enable them to collaborate more effectively, work smarter, and produce high-quality research more efficiently.

Keyresponsibilities:

• Design, build, and maintain scalable data pipelines and services

• Develop batch and ELT/ETL data workflows for ingesting and processing large datasets

• Work with technologies such as Python, Java, Spark, SQL, and Airflow

• Apply good software engineering practices, including testing, documentation, and CI/CD

• Contribute to cloud‑based systems (AWS), focusing on reliability, monitoring, and automation

• Collaborate with product, platform, and data science partners to deliver meaningful outcomes

• Support team learning through code reviews and knowledge sharing.

Requirements:

• Experience working as a data or software engineer on production systems

• Strong skills in Python and experience with at least one backend language (such as Java)

• Understanding of data engineering concepts such as data lakes, batch processing, and distributed systems

• Experience building or operating data pipelines using tools like Spark and Airflow

• Familiarity with cloud platforms (AWS preferred) and production monitoring

• Clear communication skills and a collaborative approach to problem‑solving.

Whyjoinus?

Join our team and contribute to a culture of innovation, collaboration, and excellence. If you are ready to advance your career and make a significant impact, we encourage you to apply.

Work in a way that works for you

We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. Withnumerouswellbeing initiatives and shared parental leave, we will help you meet your immediate responsibilities and your long‑term goals.

• Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive.

Working for you

We know that your well‑being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:

• Comprehensive Pension Plan

• Generous vacation entitlement andoptionfor sabbatical leave

• Maternity, Paternity, Adoption, and Family Care leave

• Flexible working hours

• Personal Choice budget

• Internal communities and networks

• Various employee discounts

• Recruitment introduction reward

• Employee Assistance Program (global)

Aboutthe business –

A global leader in information and analytics, we help researchers and healthcareprofessionalsadvance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, healtheducation,and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier,your work contributes to the world’s grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

_ USA Job Seekers: _

EEO Know Your Rights.