Data Engineer

CompuStaff; Ireland; Hybrid; EUR 70,000 - 100,000; Full time

Job summary

CompuStaff is seeking an experienced Data Engineer to join a growing technology team in Letterkenny. You will design, develop and optimise data pipelines and modern data platforms to support key business initiatives.

This hands-on role requires strong Python, SQL and PySpark skills, experience with data lakes and data warehouses, and familiarity with AWS and CI/CD practices. You will collaborate with engineers, contribute to data quality and security, and provide technical guidance while working

Qualifications

• Proven experience designing and building data pipelines.
• Strong Python and SQL skills with Spark experience.
• Experience with data lakes, data warehouses and data modelling.
• AWS experience is highly desirable.
• Excellent problem-solving and communication skills.

Responsibilities

• Build and optimise data pipelines and data integration solutions.
• Develop high-quality code using Python, SQL and PySpark/Apache Spark.
• Work with data lakes, data warehouses and database technologies.
• Develop data ingestion, transformation and real-time data solutions.
• Work with cloud technologies, ideally AWS.
• Contribute to DevOps, automation, testing and CI/CD practices.
• Help improve data quality, reliability, security and performance.
• Provide technical guidance to other engineers.

Skills

Data Engineering

Python

SQL

PySpark

Apache Spark

AWS

Kafka

Airflow

DevOps/CI-CD

Communication skills

Job description

We are looking for an experienced Data Engineerto join a growing technology team in Letterkenny, working on modern data platforms and large-scale data engineering initiatives.

This is a hands-on role where you’ll be responsible for designing, developing and optimising data pipelines and data solutions that support key business and technology initiatives.

Key Responsibilities

• Build and optimise data pipelines and data integration solutions.
• Develop high-quality code using Python, SQL and PySpark/Apache Spark.
• Work with data lakes, data warehouses and database technologies.
• Develop data ingestion, transformation and real-time data solutions.
• Work with cloud technologies, ideally AWS.
• Contribute to DevOps, automation, testing and CI/CD practices.
• Help improve data quality, reliability, security and performance.
• Provide technical guidance to other engineers.

Key Skills

• Strong commercial experience in Data Engineering.
• Excellent Python and SQL skills.
• Experience with PySpark / Apache Spark.
• Experience building data pipelines and working with large datasets.
• Experience with data lakes, data warehouses and data modelling.
• AWS experience is highly desirable.
• Experience with Kafka, Kinesis, Airflow or similar is advantageous.
• Strong problem-solving and communication skills.

Microsoft Fabric is not essential. Experience with Fabric is a bonus, but strong Data Engineering experience across Python, SQL, Spark, AWS and modern data platforms will be considered.

Hybrid role with 2/3 days per week in the Letterkenny office.