Lead Data Engineer

Renewcast S.r.l.; Roma; Ibrido; EUR 50.000 - 70.000; Tempo pieno

Descrizione del lavoro

A data-driven forecasting company in Rome seeks a Data Engineer to own and optimize data pipelines. You will lead a small team, collaborate across functions, and ensure reliable data flows. Candidates should have 7–10+ years of experience in data engineering, with a strong emphasis on performance and leadership. The role offers competitive compensation, flexible hybrid work, and opportunities for growth.

Servizi

Competitive compensation

Flexible hybrid work

Growth opportunities

Competenze

• 7–10+ years in Data Engineering with leadership/mentorship experience.
• Strong track record in building scalable batch ELT/ETL workflows.
• Experience with observability & performance optimization.

Mansioni

• Own the data foundation that powers forecasts.
• Orchestrate workflows with a focus on performance and cost efficiency.
• Mentor and manage a small team while collaborating across functions.

Conoscenze

Data Engineering

Leadership experience

Workflow orchestration

Performance optimization

Resilient pipelines

Strumenti

Airflow

Dask

Tensorflow

Descrizione del lavoro

Your Role

Own the data foundation that powers our forecasts. Design, orchestrate, and optimize reliable pipelines with a strong focus on performance, cost efficiency, observability, and reproducibility. You'll mentor/manage a small team and collaborate closely with Data Science, Meteorology, MLOps, Client Data Ingestion, and DevOps.

What You Will Do

Own the data foundation: from client weather/production data to curated, production-ready features.

Orchestrate workflows: Airflow (v3 preferred), Dagster, Prefect.

Batch ELT across multiple data sources and schedules, real-time ingestion when needed.

Alongside classic pipelines you will set up and maintain tensor-first pipelines: xarray, Zarr, Dask.

Observability & performance: metrics, logs, p50/p95 latency; cost/latency trade-offs.

Resilience: restartable and idempotent workflows, safe reruns/backfills, schema evolution tracking, lineage.

Mentor & manage: delegate well, coach where needed, stay hands-on when it matters.

Collaborate across functions to align features, architecture, SLAs.

Must-Have

7–10+ yrs in Data Engineering with leadership/mentorship experience.

Strong orchestration experience with a preference for asset-first, event-driven workflows as supported in modern orchestrators.

Strong track record in building and optimising scalable batch ELT/ETL workflows with state-of-the-art frameworks and distributed processing engines.

Experience with observability & performance optimisation (metrics, alerts, cost awareness).

Building resilient pipelines (failures, reruns, safe and tracked schema evolution, lineage tools).

Bonus Points

Tensorial stack (xarray, Zarr, Dask) or scientific formats (NetCDF, GRIB).

Familiarity with modern product oriented delivery methods (e.g., Shape Up).

How We Work

We prize autonomy, ownership, and crisp communication. Priorities and decisions are transparent across DS, Engineering, and Commercial so teams move together, not in silos.

What Success Looks Like

Clear, reliable data flows that are easier to reason about and improve.

Faster, more cost-efficient pipelines with robust monitoring/alerting.

A resilient orchestration layer and reproducible environments.

Juniors growing under your mentorship and delivering confidently.

What We Offer

Strategic ownership with direct leadership visibility to leadership.

Competitive compensation + ESOP.

Flexible hybrid work; offices in Tallinn and Rome.

Growth into discipline lead for Data Engineering.