Data Engineer - AI-Ready Pipelines & DataOps (Hybrid)

mscope; Madrid; Hybrid; EUR 48,000 - 68,000; Full time

Benefits offered by this job

25 days vacation

Birthday off!

Job summary

mscope is seeking a data engineer to build scalable data pipelines that integrate HTML, CSV, databases and embeddings. You will design models for KPIs and handle large data volumes in a fast-paced environment.

You'll prepare datasets for ML, LLMs and RAG systems, enabling AI-powered natural language queries. The role also emphasizes DataOps, CI/CD, monitoring and infrastructure optimization within a hybrid Madrid office.

Qualifications

• 3-4 years of experience in data engineering or related field.
• Experience with SQL/PL-SQL.
• Experience with Python (pandas) and Apache Spark.
• Experience with ETLs and ER models.
• Experience working with Data & Development teams.
• Experience with AWS services (EMR, Lambda) or similar Cloud.
• Fluency in Spanish and English.

Responsibilities

• Build data pipelines integrating HTML, CSV, databases and embeddings using scalable ETLs.
• Design analytical models to generate KPIs and manage large data volumes.
• Prepare datasets for ML, LLMs and RAG systems, enabling AI for natural language queries.
• Apply CI/CD, monitoring and optimize DataOps infrastructure.
• Learn about the world of alternative investment.

Skills

SQL/PL-SQL

Python (pandas)

PySpark

Apache Spark

ETL pipelines

Data modeling

AWS (EMR/Lambda)

Spanish/English bilingual

Data integration

Tools

Vector database

Scraping engines

Hadoop/AWS tooling

Job description

mscope is seeking a data engineer to build scalable data pipelines that integrate HTML, CSV, databases and embeddings. You will design models for KPIs and handle large data volumes in a fast-paced environment.

You'll prepare datasets for ML, LLMs and RAG systems, enabling AI-powered natural language queries. The role also emphasizes DataOps, CI/CD, monitoring and infrastructure optimization within a hybrid Madrid office.