Data Engineer - Cloud Pipelines, Spark & AWS

CompuStaff; Ireland; Hybrid; EUR 70,000 - 100,000; Full time

Job summary

CompuStaff is seeking an experienced Data Engineer to join a growing technology team in Letterkenny. You will design, develop and optimise data pipelines and modern data platforms to support key business initiatives.

This hands-on role requires strong Python, SQL and PySpark skills, experience with data lakes and data warehouses, and familiarity with AWS and CI/CD practices. You will collaborate with engineers, contribute to data quality and security, and provide technical guidance while working

Qualifications

• Proven experience designing and building data pipelines.
• Strong Python and SQL skills with Spark experience.
• Experience with data lakes, data warehouses and data modelling.
• AWS experience is highly desirable.
• Excellent problem-solving and communication skills.

Responsibilities

• Build and optimise data pipelines and data integration solutions.
• Develop high-quality code using Python, SQL and PySpark/Apache Spark.
• Work with data lakes, data warehouses and database technologies.
• Develop data ingestion, transformation and real-time data solutions.
• Work with cloud technologies, ideally AWS.
• Contribute to DevOps, automation, testing and CI/CD practices.
• Help improve data quality, reliability, security and performance.
• Provide technical guidance to other engineers.

Skills

Data Engineering

Python

SQL

PySpark

Apache Spark

AWS

Kafka

Airflow

DevOps/CI-CD

Communication skills

Job description

CompuStaff is seeking an experienced Data Engineer to join a growing technology team in Letterkenny. You will design, develop and optimise data pipelines and modern data platforms to support key business initiatives.

This hands-on role requires strong Python, SQL and PySpark skills, experience with data lakes and data warehouses, and familiarity with AWS and CI/CD practices. You will collaborate with engineers, contribute to data quality and security, and provide technical guidance while working