Junior Data Engineer: Scrapers, ETL & AI Enrichment - Equity

Cato; Milano; In loco; EUR 35.000 - 45.000; Tempo pieno

Descrizione del lavoro

Cato is seeking a Python developer to own and operate scrapers for national tender portals, handling the full data lifecycle from extraction to enrichment. You will maintain the scraper, job behind it, and the data output, ensuring reliability even as sources change.

You’ll work with SQL, write robust ETL scripts, and leverage orchestrators like Prefect, Airflow, or Dagster. Strong curiosity about AI enrichment and data quality is essential.

Competenze

• 1–2 years of Python in production (scrapers, ETL scripts, automation).
• Experience reading from databases daily; tuning and running queries is common.
• Exposure to orchestrators (Prefect, Airflow, Dagster) is a plus, not required.

Mansioni

• Build and maintain scrapers for national tender portals and end-to-end ownership of sources.
• Keep scrapers alive as portals change HTML, endpoints, and pagination.
• Turn messy sources into clean records: broken HTML, inconsistent XML, APIs with schema issues.
• Write and maintain orchestrator flows: retries, backfills, alerting, and run verification.

Conoscenze

Python

SQL

ETL

Web scraping

Automation

Orchestrators

Strumenti

Prefect

Airflow

Dagster

OCR

Descrizione del lavoro

Cato is seeking a Python developer to own and operate scrapers for national tender portals, handling the full data lifecycle from extraction to enrichment. You will maintain the scraper, job behind it, and the data output, ensuring reliability even as sources change.

You’ll work with SQL, write robust ETL scripts, and leverage orchestrators like Prefect, Airflow, or Dagster. Strong curiosity about AI enrichment and data quality is essential.