Remote Senior Data Engineer PySpark & AWS

Athsai; Remote; GBP 60,000 - 80,000; Full time

Job summary

A leading tech company is seeking a Senior Data Engineer to design and optimize data pipelines using PySpark and AWS. With a focus on high-volume data processing, this role involves developing ETL workflows and cloud-native solutions. Candidates should have over 6 years of experience and strong skills in Python, PySpark, SQL, and various AWS services. Join a collaborative and innovative team with competitive compensation and benefits in a fully remote capacity.

Benefits

Competitive compensation

Collaborative culture

Growth-focused environment

Qualifications

• 6+ years of hands-on experience in data engineering or related roles.
• Strong expertise in Python, PySpark, and SQL with optimized production-grade code skills.
• In-depth knowledge of Apache Spark internals and Apache Airflow.

Responsibilities

• Design, build, and maintain scalable data pipelines using PySpark and Python.
• Develop and manage ETL / ELT workflows, ensuring data accuracy and performance.
• Orchestrate workflows using Apache Airflow, including scheduling and dependency management.

Skills

Python

PySpark

SQL

AWS Services

Apache Spark

Terraform

CI/CD Pipelines

Apache Airflow

Tools

GitHub Actions

Docker

Kubernetes

Job description

A leading tech company is seeking a Senior Data Engineer to design and optimize data pipelines using PySpark and AWS. With a focus on high-volume data processing, this role involves developing ETL workflows and cloud-native solutions. Candidates should have over 6 years of experience and strong skills in Python, PySpark, SQL, and various AWS services. Join a collaborative and innovative team with competitive compensation and benefits in a fully remote capacity.