Data Engineer: AWS Pipelines & Data Lake Expert

edenpeople; Swindon, Greater London; Hybrid; GBP 39,000 - 65,000; Full time

Benefits offered by this job

25 days annual leave

Hybrid working environment

Pension scheme 6% employer

Discretionary bonus

Medical & international travel cover

Life insurance (4x salary)

Wellbeing Employee Assistance Program

Holiday trading scheme

Season ticket loan

Cycle to Work scheme

Employee discount shopping platform

Digital learning platform

Complimentary fruit and snacks

Volunteering programme

Social events

Job summary

Edenred PayTech is seeking a Data Engineer in the UK to design, develop, and maintain data pipelines and infrastructure on our platform. You will work with diverse data sources, load and transform data for quality, storage, and analysis, collaborating across teams to meet data requirements.

The role emphasizes Databricks, AWS, and data-lake management with opportunities to improve the data platform and processes while delivering reliable, scalable data solutions.

Qualifications

• Proven track record of development in Databricks.
• Proven track record of IaC usage.
• Proven track record of working with Git.
• Strong working knowledge of Python (PySpark) and SQL.
• Strong working knowledge of data management inside a datalake.
• Ability to explain technical issues to peers and customers.
• Ability to progress and complete tasks independently.
• Willingness to learn new skills and adapt to new technologies.

Responsibilities

• Design, develop and maintain data pipelines and infrastructure on AWS.
• Produce reports required for regulatory compliance.
• Collaborate with business analysts to refine user requirements and provide estimates.
• Proactively suggest ideas to improve the data platform and ways of working.
• Troubleshoot production issues.
• Unit testing.
• Documentation.

Skills

Databricks

IaC

Git

Python (PySpark)

SQL

Data lake

Data pipelines

Problem solving

Independent worker

Learning mindset

Tools

AWS

Terraform

CI/CD

Job description

Edenred PayTech is seeking a Data Engineer in the UK to design, develop, and maintain data pipelines and infrastructure on our platform. You will work with diverse data sources, load and transform data for quality, storage, and analysis, collaborating across teams to meet data requirements.

The role emphasizes Databricks, AWS, and data-lake management with opportunities to improve the data platform and processes while delivering reliable, scalable data solutions.