Data Engineer , Python, PySpark, and SQL, AWS

JR United Kingdom; Bedford; On-site; GBP 40,000 - 70,000; Full time

Job summary

A leading company in the UK is seeking a Data Engineer to design and implement robust data pipelines. The role requires expertise in Python, PySpark, SQL, and AWS. This opportunity involves ensuring data integrity and accessibility across platforms, offering a competitive salary in a dynamic environment.

Qualifications

• Proficient in PySpark and AWS.
• Strong experience in designing, implementing, and debugging ETL pipelines.
• Expertise in Python, PySpark, and SQL.

Responsibilities

• Design and implement robust data pipelines.
• Ensure the integrity and accessibility of data across various platforms.

Skills

PySpark

AWS

Python

SQL

ETL pipelines

Spark

Airflow

Terraform

CI/CD workflows

Job description

Social network you want to login/join with:

Data Engineer , Python, PySpark, and SQL, AWS, bedford

col-narrow-left

Client:

Athsai

Location:

bedford, United Kingdom

Job Category:

Other

-

EU work permit required:

Yes

col-narrow-right

Job Views:

3

Posted:

06.06.2025

Expiry Date:

21.07.2025

col-wide

Job Description:

About the Role

The Data Engineer will play a crucial role in designing and implementing robust data pipelines, ensuring the integrity and accessibility of data across various platforms.

Required Skills

• Proficient in PySpark and AWS
• Strong experience in designing, implementing, and debugging ETL pipelines
• Expertise in Python, PySpark, and SQL
• In-depth knowledge of Spark and Airflow
• Experience in designing data pipelines using cloud-native services on AWS
• Extensive knowledge of AWS services
• Experience in deploying AWS resources using Terraform
• Hands-on experience in setting up CI/CD workflows using GitHub Actions

Preferred Skills

• Experience with additional cloud platforms
• Familiarity with data governance and compliance standards