Data Engineer: Hadoop & PySpark Pipelines

Keoni; Paris; Hybrid; EUR 55,000 - 90,000; Full time

Job summary

Keoni is seeking a Data Engineer to join its European team to design and implement data ingestion, transformation, and analytics pipelines. You will work with Hadoop, PySpark, Hive, SQL, and Unix/Linux shell scripting to deliver robust data solutions.

The ideal candidate has 3–6 years of experience, is autonomous, proactive, and collaborative within an international environment. Fluent English is essential for daily communication.

Qualifications

• 3–6 years of Data Engineer experience in Hadoop/PySpark ecosystems.
• Strong knowledge in SQL, Hive, and data warehousing concepts.
• Proficient in Unix/Linux shell scripting and automation.
• Experience in data ingestion, transformation, and pipeline development.

Responsibilities

• Implement new data ingestion processes and pipelines.
• Perform data preparation and transformation tasks.
• Develop and upgrade data pipelines using PySpark.
• Perform Unix/Linux shell scripting and automation.
• Collaborate with DevOps on platform enhancements.
• Maintain operational readiness and data processing workflows.
• Write technical specifications and document solutions.

Skills

Hadoop

PySpark

Hive

SQL

Unix/Linux Shell Scripting

Agile/Scrum

Tools

Git

Jenkins

Jira

GCP

BigQuery

API Libraries (Python)

Job description

Keoni is seeking a Data Engineer to join its European team to design and implement data ingestion, transformation, and analytics pipelines. You will work with Hadoop, PySpark, Hive, SQL, and Unix/Linux shell scripting to deliver robust data solutions.

The ideal candidate has 3–6 years of experience, is autonomous, proactive, and collaborative within an international environment. Fluent English is essential for daily communication.