Senior Data Engineer - AI-Ready Metadata & Lineage (Remote)

Intellias; España; Presencial; EUR 70.000 - 90.000; Jornada completa

Descripción de la vacante

Intellias in Spain is seeking a senior Python data engineer with strong data-engineering skills to design and build AI-ready data foundations for safe, scalable enterprise AI. You will create catalogues, semantic and analytical layers turning large on-premise estates into usable data for AI agents.

Required are 5+ years in production data systems, experience with crawlers and Kafka, and proficiency in search stores like Elasticsearch or MongoDB.

Formación

• 5+ years building production data systems in Python.
• Experience building crawlers, harvesters or connectors for inventories, schemas and lineage.
• Event-driven integration with Kafka or similar with secure patterns.
• Experience with search/document stores like Elasticsearch/OpenSearch/MongoDB.
• Familiarity with lineage modelling and OpenLineage or similar.

Responsabilidades

• Build extraction, enrichment and registration paths for domain catalogues from live estates.
• Extend scraping to full metadata including descriptions and dictionaries.
• Load vendor schema metadata at scale into internal knowledge bases.
• Seed inventories from ETL sources and draft LLm-generated descriptions for steward review.
• Integrate lineage into the client lineage backend across systems.

Conocimientos

Python

Data engineering

SQL

Event-driven

English fluency

Educación

Bachelor's degree in CS/IS

Herramientas

Kafka

Elasticsearch

MongoDB

OpenLineage

Descripción del empleo

Intellias in Spain is seeking a senior Python data engineer with strong data-engineering skills to design and build AI-ready data foundations for safe, scalable enterprise AI. You will create catalogues, semantic and analytical layers turning large on-premise estates into usable data for AI agents.

Required are 5+ years in production data systems, experience with crawlers and Kafka, and proficiency in search stores like Elasticsearch or MongoDB.