Senior Data Engineer: AWS, Databricks & ML Pipelines

Madfish; United Kingdom; Remote; GBP 60,000 - 80,000; Full time

Job summary

A leading SaaS company in the United Kingdom seeks a Senior Software Data Engineer to design and optimize scalable data pipelines using PySpark and AWS. Candidates should have over 5 years of experience and strong expertise in Python, SQL, and automated testing. The role involves delivering accurate and reliable data outputs while collaborating across cross-functional teams. This remote position offers a full-time 6-month contract with potential for extension.

Qualifications

• 5+ years of professional experience as a Data Engineer.
• Strong expertise in PySpark, Python, and SQL.
• Experience with AWS data ecosystem.

Responsibilities

• Design, build, and optimize scalable data pipelines using PySpark and AWS services.
• Deliver production-grade data outputs with high accuracy and reliability.
• Develop automated testing frameworks to support end-to-end data quality.

Skills

PySpark

Python

SQL

AWS

Automated testing

Debugging

Performance optimization

MLflow

Tools

Databricks (DBX)

Job description

A leading SaaS company in the United Kingdom seeks a Senior Software Data Engineer to design and optimize scalable data pipelines using PySpark and AWS. Candidates should have over 5 years of experience and strong expertise in Python, SQL, and automated testing. The role involves delivering accurate and reliable data outputs while collaborating across cross-functional teams. This remote position offers a full-time 6-month contract with potential for extension.