Data Engineer Hadoop / PySpark

Keoni; Paris; Hybrid; EUR 55,000 - 90,000; Full time

Job summary

Keoni is seeking a Data Engineer to join its European team to design and implement data ingestion, transformation, and analytics pipelines. You will work with Hadoop, PySpark, Hive, SQL, and Unix/Linux shell scripting to deliver robust data solutions.

The ideal candidate has 3–6 years of experience, is autonomous, proactive, and collaborative within an international environment. Fluent English is essential for daily communication.

Qualifications

• 3–6 years of Data Engineer experience in Hadoop/PySpark ecosystems.
• Strong knowledge in SQL, Hive, and data warehousing concepts.
• Proficient in Unix/Linux shell scripting and automation.
• Experience in data ingestion, transformation, and pipeline development.

Responsibilities

• Implement new data ingestion processes and pipelines.
• Perform data preparation and transformation tasks.
• Develop and upgrade data pipelines using PySpark.
• Perform Unix/Linux shell scripting and automation.
• Collaborate with DevOps on platform enhancements.
• Maintain operational readiness and data processing workflows.
• Write technical specifications and document solutions.

Skills

Hadoop

PySpark

Hive

SQL

Unix/Linux Shell Scripting

Agile/Scrum

Tools

Git

Jenkins

Jira

GCP

BigQuery

API Libraries (Python)

Job description

Mission context: The consultant will work closely with the application production and DevOps teams to implement technical changes to the platform.Main Responsibilities • Implement new data ingestion processes. • Perform data preparation/transformation processes. • Develop, maintain, and upgrade data pipelines using PySpark. • Perform shell scripting under Unix/Linux. • Collaborate with the DevOps team on platform enhancement requests. • Participate in maintaining operational readiness and developing data processing processes. • Write technical specifications and document implemented solutions.Essential skills: Excellent proficiency expected in: • Hadoop • Python / PySpark • Hive • SQL • Unix/Linux Shell ScriptingEnvironment/Tools: • Git • Jenkins • Jira • Agile/Scrum MethodologyProfessional English is essential, both written and spoken.Desired/Differentiating Skills: Experience with the following technologies would be a plus: Indexima, Alteryx, Altair, GCP, BigQuery, and API-oriented Python libraries. Ideal Candidate Profile: Data Engineer with 3 to 6 years of experience, highly proficient in the Hadoop/PySpark ecosystem, and a genuine passion for developing and processing large volumes of data. The consultant must be autonomous, proactive, a strong problem-solver, and technically curious, with excellent analytical and problem-solving skills. Strong interpersonal skills and the ability to work effectively in a team within an international environment are also essential.Application: CV + cover letter + copies of diplomas to be sent to [e-mail] in 2008, Kéoni Consulting is an IT consulting and engineering firm specializing in the banking, financial markets, insurance, and industrial sectors. We are the partner for major accounts in their digital transformation. We help them transform their business model, align their operational processes, select the best technologies, and mitigate and overcome the risks associated with digitalization. Kéoni Consulting helps companies to: Make a difference , innovate and create , reinvent their business, satisfy customers, gain a competitive advantage, become the leader in their sector, and become the leader in their sector. Our services cover the entire information systems lifecycle (Project Management, Business Analysis Consulting, Design, Implementation, Maintenance, Production, and Operations).**Job Category:** Digital Transformation**Job Type:** Full Time**Work location:** Europe