Data Engineering Lead

TN United Kingdom; United Kingdom; On-site; GBP 60,000 - 100,000; Full time

Job summary

An innovative firm is seeking a Technical Lead to drive their strategic Data Platform initiatives. You will architect and develop advanced data integration solutions while mentoring a talented team of data engineers. This role emphasizes best practices in data engineering and promotes a healthy work/life balance with flexible hours and numerous wellbeing initiatives. Join a forward-thinking organization that values your contributions and supports your long-term career goals with generous benefits and learning opportunities.

Benefits

Generous holiday allowance

Health screening and private medical benefits

Life assurance

Competitive pension scheme

Save As You Earn share option scheme

Travel Season ticket loan

Electric Vehicle Scheme

Maternity and paternity leave

Employee Assistance Programme

Access to learning and development resources

Qualifications

• Expertise in Python and PySpark is essential for leading the team.
• Ability to design scalable data architectures for batch and streaming processing.

Responsibilities

• Lead the development of the patent data ingestion pipeline using Databricks.
• Mentor a team of data engineers, fostering collaboration and innovation.

Skills

Python

PySpark

Databricks

Data Architecture

Cloud Platforms (AWS, Azure, Google Cloud)

Data Governance

Job description

Social network you want to login/join with:

col-narrow-left

Client:

Location:

Job Category:

-

EU work permit required:

Yes

col-narrow-right

Job Reference:

1ba742308296

Job Views:

10

Posted:

26.04.2025

Expiry Date:

10.06.2025

col-wide

Job Description:

About the Role

As the technical lead for the team building the strategic Data Platform at LexisNexis IP, you will be instrumental in executing our data strategy for the Data Platform. Your role will be pivotal in developing and implementing advanced solutions for data integration, quality control, and continuous delivery, driving our data operations to new heights.

Your expertise will be crucial in embedding best practices and state-of-the-art data engineering tools, ensuring that our workflows are both efficient and scalable.

Responsibilities

• Architecting and leading the development of our patent data ingestion pipeline using Databricks, Python, and PySpark.
• Mentoring and guiding a team of data engineers, fostering a collaborative environment that encourages growth and innovation. You will enable and lead technical discussions within the team and with stakeholders
• Ensuring the pipeline is efficient, scalable, and robust, capable of handling terabytes of data with low latency. Eliminate inefficiencies and teach the techniques to the team.
• Contributing to the overall data engineering strategy and drive the adoption of best practices in coding, architecture, and deployment.
• Identifying and resolving technical challenges, ensuring the smooth operation of the data ingestion pipeline.
• Automating the boring stuff, and make space for the team to tackle the most challenging up and coming problems.

Requirements

• Demonstrate expertise in Python, and PySpark is essential for you to lead the skill up the team.
• Demonstrate expertise in Databricks would be highly desirable and advantageous.
• Demonstrate ability to design and implement scalable data architectures for both batch and streaming data processing.
• Demonstrate proficiency in using cloud platforms such as AWS, Azure, or Google Cloud for data infrastructure management
• Knowledge of data governance practices, including data quality management, metadata management, and data lineage
• Proven experience in leading and mentoring technical data engineering teams.

Work in a way that works for you

We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.

• Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive

Working for you

We know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer

• Generous holiday allowance with the option to buy additional days
• Health screening, eye care vouchers and private medical benefits
• Life assurance
• Access to a competitive contributory pension scheme
• Save As You Earn share option scheme
• Travel Season ticket loan
• Electric Vehicle Scheme
• Maternity, paternity and shared parental leave
• Employee Assistance Programme
• Access to emergency care for both the elderly and children
• RECARES days, giving you time to support the charities and causes that matter to you
• Access to employee resource groups with dedicated time to volunteer
• Access to extensive learning and development resources
• Access to employee discounts scheme via Perks at Work