Senior Data Engineer

LexisNexis; Cape Town; On-site; ZAR 700 000 - 900 000; Full time

Job summary

A leading legal information provider is seeking a Senior Data Engineer in Cape Town. You will design scalable data pipelines using Python and Databricks, mentor junior engineers, and collaborate with cross-functional teams to deliver high-quality data solutions. The role requires extensive experience in data engineering, proficiency in Python, and familiarity with cloud platforms. Competitive benefits include medical aid and a flexible working schedule, enhancing both productivity and job satisfaction.

Benefits

Medical Aid

Retirement Plan

Study Leave

Modern family benefits

Qualifications

• Extensive experience in data engineering or backend software engineering.
• Proficient in Python, PySpark, and Databricks environments.
• Experience with REST APIs and event-driven systems.

Responsibilities

• Design and optimize scalable data pipelines.
• Drive delivery of customer-facing data products via APIs.
• Mentor and coach junior engineers.

Skills

Python

PySpark

Databricks

API development

Cloud platforms

Agile practices

Job description

About our Team

LexisNexis Legal & Professional, which serves customers in more than 150 countries with 11,800 employees worldwide, is part of RELX, a global provider of information-based analytics and decision tools for professional and business customers. Our company has been a long-time leader in deploying AI and advanced technologies to the legal market to improve productivity and transform the overall business and practice of law, deploying ethical and powerful generative AI solutions with a flexible, multi-model approach that prioritizes using the best model from today’s top model creators for each individual legal use case.

About the Role

As a Senior Data Engineer at LexisNexis Intellectual Property (LNIP), you will play a key role in delivering high-quality, scalable data solutions that power our Strategic Data Platform — the backbone for products like PatentSight+ and other analytics offerings. In this role, you will design data pipelines, mentor team members, promote engineering best practices, and help deliver customer datasets using Databricks, APIs, and event-driven systems. You will manage complex tasks, influence architecture decisions, and work closely with stakeholders. This position suits those who thrive on large-scale data challenges, team development, and platform growth.

Responsibilities

• Designing, implementing, and optimising scalable data pipelines using Python, PySpark, and Databricks.
• Driving the delivery of customer-facing data products through APIs, Databricks-based sharing, and event-driven mechanisms (e.g., Kafka or similar).
• Taking ownership of end-to-end features — from scoping and development to deployment and monitoring.
• Leading and participating in technical design discussions, contributing to architectural improvements and long-term data strategy.
• Mentoring and coaching junior engineers actively while supporting their technical and professional development.
• Collaborating with cross-functional teams to understand business requirements and translate them into technical solutions.
• Conducting peer code reviews, upholding code quality standards, and championing continuous improvement practices.
• Contributing to the team’s agile delivery process and providing input during planning and retrospectives.

Requirements

• Have extensive experience in data engineering or backend software engineering with a data focus.
• Be proficient in Python, PySpark, and working within Databricks environments.
• Have hands‑on experience designing and delivering data products via REST APIs, event-driven systems, or data sharing platforms like Databricks Delta Sharing.
• Have a solid understanding of distributed data processing, ETL/ELT workflows, and data lake/lakehouse architectures.
• Have experience with cloud platforms (e.g., AWS, Azure, GCP) and modern data tooling.
• Have a proven track record of mentoring or coaching other engineers.
• Have effective communication and collaboration skills, including the ability to explain complex concepts to non‑technical stakeholders.
• Be familiar with agile development practices.

Work in a way that works for you

• Working flexible hours — flexing the times when you work in the day to help you fit everything in and work when you are the most productive.

Working for you

• Medical Aid
• Retirement Plan inclusive of Risk Benefits (Disability, Critical Illness, Life Cover & Funeral Cover)
• Modern family benefits, including adoption and surrogacy
• Study Leave

About the Business

LexisNexis Legal & Professional® provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis® and Nexis® services.

Benefits

We know that your well‑being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers: EEO Know Your Rights.