Data Engineer - AWS Databricks Pipelines (Hybrid)

Edenred SE; Swindon; Hybrid; GBP 59,000 - 72,000; Full time

Benefits offered by this job

25 days annual leave

Hybrid working environment

Pension scheme

Discretionary bonus

Medical & international travel cover

Life insurance

Wellbeing programme

Cycle to Work

Employee discount platform

Digital learning platform

Volunteering programme

Social events

Job summary

Edenred PayTech in Swindon/London is seeking a Data Engineer to design, build, and maintain data pipelines and infrastructure on our platform. You will work across sources, load and transform data, ensuring quality, reliability and regulatory reporting.

You will collaborate with analysts to refine requirements, estimate efforts, and suggest improvements to the data platform while solving production issues. Hybrid work available.

Qualifications

• Proven track record of development in Databricks.
• Proven track record of working with IaC.
• Proven track record of working with git.
• Strong working knowledge of Python (Pyspark) and SQL.
• Strong working knowledge of data management inside a datalake.
• Proven ability to explain technical issues and solutions to peers and customers.
• Proven ability to independently progress and complete tasks.
• Strong desire to learn new skills and adapt new technologies.

Responsibilities

• Design, develop and maintain data pipelines and infrastructure on AWS.
• Produce reports required for regulatory compliance.
• Collaborate with business analysts to refine user requirements and provide estimates.
• Proactively suggest ideas to improve the data platform and ways of working.
• Troubleshoot production issues.
• Unit Testing.
• Documentation.

Skills

Databricks

IaC

Git

Python (PySpark)

Data lake

Explain technical issues

Independent progress

Learning new skills

Tools

AWS

Terraform

CI/CD

Job description

Edenred PayTech in Swindon/London is seeking a Data Engineer to design, build, and maintain data pipelines and infrastructure on our platform. You will work across sources, load and transform data, ensuring quality, reliability and regulatory reporting.

You will collaborate with analysts to refine requirements, estimate efforts, and suggest improvements to the data platform while solving production issues. Hybrid work available.