Data Developer (Python, SQL, Shell, Spark)

Keoni; Paris; Hybrid; EUR 60,000 - 90,000; Full time

Job summary

Keoni is seeking a Data Developer with 5+ years of experience in Python, SQL, Shell and Spark to support CLoudera Hadoop-based data platforms. You will develop and maintain data ingestion, populate the Datalake, and provide user support in a high-demand production environment.

You will mentor juniors, review code, and ensure delivery deadlines while improving platform performance and usability. Knowledge of Power BI and SAS is a plus.

Qualifications

• 5+ years of experience with Python, SQL, Shell, and Spark on Cloudera Hadoop.
• Experience in data extraction, data lake feeding, and production support.
• Ability to document, mentor apprentices, and perform code reviews.

Responsibilities

• Evolve data to be integrated and feed the Datalake, adapting to needs.
• Develop SQL extractions and automated Shell scripts for data processing.
• Provide level 2 support and ensure delivery deadlines in a high-demand environment.
• Contribute to platform maintainability, performance, and usability.

Skills

Python

SQL

Shell scripting

Spark

Hadoop Cloudera

Hive

Impala

Git usage

JIRA

Agile methodologies

Communication

Tools

Power BI

SAS

Jupyter

VBA

Job description

# Data Developer (Python, SQL, Shell, Spark)* Data Developer (Python, SQL, Shell, Spark)CONTEXT: As part of their Big Data activities, the client is seeking a Data Developer with experience in Python, SQL, Shell, and Spark (5+ years) to support their work on the Cloudera Hadoop platform. The objective of this role is to develop and maintain the necessary components to populate the Hadoop platform, implement data extraction, and provide user support.MISSIONS Reporting to the Big Data Manager, the profile will have the following main missions: – to take charge of the evolution of the data to be integrated, take over the developments made for feeding the Datalake, and evolve them according to needs (Technical Stack: Hadoop Cloudera, Hive, Impala, Python, Shell, Linux, SQL, VBA, Jupyter) – to have technical expertise enabling the technical specification of tasks, provide reference queries, perform code review, and mentor potential apprentices or interns (one apprentice to date) – to implement extractions from this data, – to provide level 2 support, – to ensure that instructions are followed by users, – to guarantee that delivery deadlines are met in a high-demand production environment – to contribute to ensuring the maintainability of the platform as well as its performance and usability. They will ensure compliance with the use of referenced models or their evolution in collaboration with the IT Technical Department and the Data Governance team.The ideal candidate will possess proven skills and qualities in communicating diplomatically, listening, integrating, sharing expertise, documenting actions, and providing support. In the same vein, some expected skills include: – Developing data feed processes, strong ability to structure activities (JIRA), implementation and documentation of processes (guides, user support, etc.), and operational management of specific topics – Developing SQL extractions (expert level) and advanced shell scripting for automation – Ability to investigate and reverse engineer complex legacy architectures – Optimizing platform and user processesPROFILE & SKILLS – Ability to explain the subject simply, to communicate with stakeholders such as developers, design offices, quality assurance engineers, and clients. Knowledge of Power BI and SAS is a plus. Required: Hadoop Cloudera, Hive, Impala, Python, Shell scripting, Linux, SQL, VBA. A plus: Jupyter.Technical Skills: Knowledge of Cloudera, Hadoop, Hive, Impala; Python development; SQL querying; Shell scripting; Spark (Scala) development ; Git usage; Agile methodologies (Kanban and/or Scrum). Environmental Skills: Knowledge of the social protection ecosystem**Work location:** Europe