DATA ENGINEER (Data Science & Big Data Analytics)

Financecolombia; Barcelona; Presencial; EUR 30.000 - 50.000; Jornada completa

Descripción de la vacante

A leading technology center in Barcelona is seeking a highly motivated Data Engineer to design and deploy data pipelines, contribute to machine learning projects, and assist with multi-cloud deployments. The ideal candidate will have experience with orchestration systems, containerization, and big data architectures. This position requires strong project management skills, especially in EU funded initiatives.

Formación

• Experience in designing and deploying data pipelines.
• Familiarity with orchestration systems like Airflow or Dagster.
• Understanding of containerization with Docker or Kubernetes.
• Participation in Machine Learning projects.
• Knowledge of multi-cloud deployments (AWS, Azure, GCP).
• Experience with Big Data Architectures and tools (Flink, Spark, Kafka).
• Project management experience, especially in EU funded projects.

Responsabilidades

• Design and deploy data pipelines for data warehousing.
• Architect reusable software practices using orchestration systems.
• Deploy data sharing and cataloguing tools for Data Spaces.
• Contribute to Machine Learning projects.
• Assist with multi-cloud deployments.
• Design Big Data Architectures for batch and streaming.
• Lead technical aspects of EU funded projects.

Descripción del empleo

EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit.

Functions and responsibilities of the job:

Functions and responsibilities of the job

• Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing.
• Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes.
• Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware.
• Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL.
• Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform).
• When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem.
• Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description…)