Data Engineer - End-to-End Pipelines & AI Enrichment

Cato; Barcelona; Presencial; EUR 40.000 - 60.000; Jornada completa

Descripción de la vacante

Cato is hiring a data engineer to build and run the pipelines that move tenders from source portals to customers. You own ingestion, merge, enrichment, and delivery end to end, with real ownership over data sources, jobs and tables.

You will work on scrapers for portals in Spain and Italy, write robust orchestrations (Prefect, Airflow, Dagster, Argo), perform AI enrichment with LLM extraction, and ensure production SQL performance.

Formación

• 2–4 years building data pipelines in production.
• Hands-on with PostgreSQL beyond writing queries—you've had to make one fast.
• Exposure to LLM-based extraction is welcome; curiosity about it is mandatory.

Responsabilidades

• Own scrapers and ingestion for a set of national portals across Spain and Italy.
• Write and maintain orchestrator flows: retries, backfills, alerting, and validation.
• Work on merge, dedup and reconciliation to deliver a single correct tender.
• Ship AI enrichment steps: batch LLM extraction, embeddings, OCR on attachments.
• Write production SQL with query plans, indexes, JSONB, partitioning, and migrations.
• Guard data quality with tests and checks that fail loudly.

Conocimientos

SQL mastery

Python production

Data pipelines

Automation mindset

Troubleshooting

Herramientas

PostgreSQL

Prefect

Airflow

Dagster

ArgoWorkflows

JSONB

Descripción del empleo

Cato is hiring a data engineer to build and run the pipelines that move tenders from source portals to customers. You own ingestion, merge, enrichment, and delivery end to end, with real ownership over data sources, jobs and tables.

You will work on scrapers for portals in Spain and Italy, write robust orchestrations (Prefect, Airflow, Dagster, Argo), perform AI enrichment with LLM extraction, and ensure production SQL performance.