Big Data Engineer — Pipelines, Spark & DataOps

Capgemini; Roma; On-site; EUR 55,000 - 85,000; Full time

Benefits offered by this job

Work with cutting-edge tech

Competitive salary and benefits

Dynamic work environment with growth opportunities

Make a real impact on groundbreaking projects

Job summary

A leading tech innovator in Rome is seeking a talented Big Data Engineer to join their dynamic team. You will design, implement, and optimize data pipelines to handle massive volumes of data efficiently. The ideal candidate will have a Bachelor’s or Master’s in a related field and proven experience with technologies like Hadoop and Spark, as well as proficiency in programming languages such as Java and Python. This role offers a competitive salary and dynamic work environment with growth opportunities.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• Proven experience with Big Data technologies like Hadoop, Spark, Hive.
• Proficiency in Java, Python, R, PL/SQL, or similar languages.
• Strong understanding of ETL processes, data modeling, and data quality principles.
• Experience with Modern DWH, Lambda/Kappa architectures, and Distributed Systems.
• Familiarity with Data Virtualization tools and DevOps techniques is a plus.
• Preferred knowledge of PySpark and advanced analytics techniques.
• Proficiency in English (written and spoken).
• Excellent problem-solving skills.

Responsibilities

• Design, develop, and optimize robust data architectures and pipelines.
• Collaborate with cross-functional teams to translate business needs into technical solutions.
• Ensure data security, integrity, and compliance across systems.
• Stay ahead of the curve with emerging trends in Big Data and analytics.

Skills

Big Data technologies (Hadoop, Spark, Hive)

Java

Python

R

PL/SQL

ETL processes

Data modeling

Data quality principles

Modern DWH architectures

DevOps techniques

Education

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field

Tools

Data Virtualization tools

PySpark

Job description

A leading tech innovator in Rome is seeking a talented Big Data Engineer to join their dynamic team. You will design, implement, and optimize data pipelines to handle massive volumes of data efficiently. The ideal candidate will have a Bachelor’s or Master’s in a related field and proven experience with technologies like Hadoop and Spark, as well as proficiency in programming languages such as Java and Python. This role offers a competitive salary and dynamic work environment with growth opportunities.