Hydrology Big Data Engineer — Scalable Data Pipelines

BWI; Toulouse; On-site; EUR 60,000 - 80,000; Full time

Job summary

A leading water intelligence firm in Toulouse is seeking a skilled Big Data Engineer to build and operate data pipelines for large volumes of hydrological and weather data. Candidates should have a minimum of 5 years of experience, strong Python programming skills, and a solid understanding of ETL processes. This full-time role requires collaboration with scientists to enhance data accuracy and delivery, ensuring observability and performance optimization through modern cloud technologies and coding best practices.

Qualifications

• 5+ years of experience required, with 3+ years specifically in data pipeline operations.
• Strong software engineering skills with Python and CI/CD methods.
• Experience with large datasets and architectural patterns.

Responsibilities

• Implement data ingestion and publishing workflows.
• Collaborate with scientists to define data models.
• Optimize performance and manage distributed workloads.

Skills

Python

Data Engineering

ETL/ELT

Cloud (AWS)

Containerization

Education

Computer Science degree

Tools

Terraform

PySpark

Dask

Job description

A leading water intelligence firm in Toulouse is seeking a skilled Big Data Engineer to build and operate data pipelines for large volumes of hydrological and weather data. Candidates should have a minimum of 5 years of experience, strong Python programming skills, and a solid understanding of ETL processes. This full-time role requires collaboration with scientists to enhance data accuracy and delivery, ensuring observability and performance optimization through modern cloud technologies and coding best practices.