Hybrid Data Engineer: Spark, PySpark & AWS

GIOS Technology

Glasgow

On-site

GBP 60,000 - 90,000

Full time

24 hours ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

GIOS Technology in Glasgow, Scotland is seeking a hands-on Data Engineer to design, build, and maintain scalable data pipelines and data lakes in AWS. You will work with PySpark, Spark, Python, and CloudFormation to deliver high-performance data solutions for enterprise analytics.

The role emphasizes collaboration with Data Scientists and Analytics teams, building production-grade ETL/ELT frameworks, and implementing CI/CD with GitLab while advancing platform modernization and secure data

Qualifications

Experience delivering production-grade data solutions.
Strong PySpark, Spark, Python and SQL skills.
Experience with AWS data services and IaC using CloudFormation.

Responsibilities

Design, develop, and maintain scalable batch and real-time data pipelines using PySpark, Spark, Python, and AWS services.
Build and optimize data lakes and data warehouse solutions ensuring data quality, security, and accessibility.
Develop reusable, production-grade ETL/ELT frameworks and data processing solutions.
Implement orchestration workflows using AWS Step Functions, Airflow, and other automation tools.
Develop and maintain cloud infrastructure using AWS CloudFormation.
Collaborate with business stakeholders to understand requirements and translate them into scalable technical solutions.
Optimize data processing performance, monitoring, and operational support.
Implement unit testing, code reviews, and CI/CD best practices using GitLab.
Support platform modernization and migration initiatives leveraging Spark-based architectures.
Work closely with Data Scientists and Analytics teams to enable AI/ML use cases.