Big Data Specialist

HCLTech; Paris; Hybride; EUR 80 000 - 120 000; Plein temps

Résumé du poste

A leading company is seeking a Principal Java Big Data Engineer with extensive experience in Java and cloud technologies. The role involves architecting data platforms, leading technical strategies, and mentoring teams to deliver scalable solutions. Candidates should possess strong leadership skills and a deep understanding of big data frameworks and Azure services.

Qualifications

• 4 to 30 years of experience in relevant technologies.
• Expert-level proficiency in Java and Apache Spark.
• Strong leadership and communication skills.

Responsabilités

• Define and drive the technical vision for large-scale data platforms.
• Architect and implement robust Big Data pipelines.
• Mentor senior and junior engineers.

Connaissances

Java

Apache Spark

Kafka

Azure

Hadoop

Angular

PostgreSQL

Outils

Azure DevOps

Git

Terraform

Description du poste

Experience : Required : 4 to 30 Years

Location : Paris, France

Mode of Work : Hybrid

Job Summary

We are seeking a seasoned Principal Java Big Data Engineer with 4 to 30 years of deep expertise in Java, Azure, Apache Spark, Kafka, Azure DevOps, Hadoop, Angular, and PostgreSQL.

This role involves architecting enterprise-grade data platforms, guiding technical strategy, mentoring engineering teams, and delivering mission-critical, scalable solutions in a cloud-native environment.

Key Responsibilities

• Strategic Leadership : Define and drive the technical vision for large-scale data platforms, leveraging Java, Apache Spark, Kafka, and Azure technologies.
• Enterprise Architecture : Architect and implement robust Big Data pipelines using Hadoop, Spark, and Kafka for real-time and batch processing at scale.
• Azure Cloud Mastery : Lead the design and deployment of cloud-native solutions using Azure services (e.g., Azure Databricks, Azure Data Factory, Azure Data Lake, Synapse Analytics).
• Azure DevOps Excellence : Oversee end-to-end CI / CD pipelines, infrastructure-as-code (IaC), and automated deployments using Azure DevOps and related tools.
• Front-End Integration : Guide the development of sophisticated, data-driven user interfaces using Angular, ensuring seamless integration with backend systems.
• Database Leadership : Architect and optimize PostgreSQL databases for high-performance, scalable data management.
• Performance & Scalability : Optimize distributed data workflows for performance, cost-efficiency, and resilience in complex, high-volume environments.
• Mentorship & Leadership : Mentor senior and junior engineers, fostering a culture of innovation, technical excellence, and continuous learning.
• Cross-Functional Collaboration : Partner with executives, data scientists, product managers, and architects to align technical solutions with strategic business objectives.
• Code & Quality Standards : Establish and enforce rigorous standards for code quality, security, and maintainability through reviews, testing, and best practices.
• Operational Excellence : Ensure system reliability, scalability, and uptime by leading monitoring, troubleshooting, and incident resolution efforts.

Technical Skills :

• Expert-level proficiency in Java (Spring Boot, Hibernate, or similar frameworks).
• Advanced expertise in Apache Spark and Kafka for distributed processing and real-time streaming.
• Comprehensive knowledge of Hadoop ecosystem and Big Data frameworks.
• Mastery of Azure services for data storage, processing, analytics, and orchestration.
• Deep experience with Azure DevOps, Git, and IaC (e.g., ARM templates, Bicep, Terraform).
• Strong proficiency in Angular for building scalable, responsive front-end applications.
• Expert-level skills in PostgreSQL database design, query optimization, and performance tuning.
• In-depth understanding of distributed systems, microservices, RESTful APIs, and event-driven architectures.

Soft Skills :

• Exceptional leadership, with a proven ability to inspire and guide technical teams.
• Strategic thinking and strong problem-solving skills.
• Outstanding communication and stakeholder engagement abilities.
• Ability to navigate ambiguity and thrive in a dynamic, fast-paced environment.

Preferred Qualifications

• Experience with advanced Big Data tools (e.g., Apache Flink, Hive, Presto, or Druid).
• Knowledge of machine learning frameworks or AI-driven data pipelines.
• Proven leadership in Agile / Scrum environments, with experience driving large-scale projects.