Data Engineer: PySpark, AWS Glue & ETL Specialist

Thrive IT Systems; Dublin; In loco; EUR 75.000 - 110.000; Tempo pieno

Descrizione del lavoro

Thrive IT Systems in Ireland seeks a Data Engineer who can connect technical fundamentals with real project delivery. You will write PySpark and SQL code independently, explain Spark execution and performance concepts, and discuss an end-to-end AWS-based ETL pipeline.

The role emphasizes troubleshooting and building scalable data pipelines, with strong SQL and PySpark teamwork. Familiarity with AWS Glue, Spark architecture, and the Hadoop ecosystem will help you optimize jobs and support

Competenze

• Must understand ETL vs ELT and end-to-end data pipelines.
• Must write PySpark and SQL confidently with minimal prompting.
• Strong grasp of Spark execution, optimization, and cost awareness.
• Hands-on AWS Glue knowledge and troubleshooting mindset.

Conoscenze

ETL / end-to-end pipelines

PySpark

SQL

Spark architecture

AWS Glue

Troubleshooting

End-to-end thinking

Data quality

Strumenti

Databricks

Hadoop (HDFS / Hive)

Descrizione del lavoro

Thrive IT Systems in Ireland seeks a Data Engineer who can connect technical fundamentals with real project delivery. You will write PySpark and SQL code independently, explain Spark execution and performance concepts, and discuss an end-to-end AWS-based ETL pipeline.

The role emphasizes troubleshooting and building scalable data pipelines, with strong SQL and PySpark teamwork. Familiarity with AWS Glue, Spark architecture, and the Hadoop ecosystem will help you optimize jobs and support