Senior Data Engineer

Antal International Network; Lérida; A distancia; EUR 45.000 - 70.000; Jornada completa

Descripción de la vacante

A leading company in the audiovisual industry is seeking a Senior Data Engineer to enhance its AI Team. The role involves designing data pipelines, collaborating with data scientists and ML engineers to combat misinformation. Candidates should possess strong skills in cloud platforms, SQL, and Python, and be comfortable working in a fast-paced environment. The position allows for full remote work, enriching team-building opportunities, and a chance to contribute significantly to impactful projects.

Servicios

Full remote work option

Team-building activities

Positive work environment

Formación

• At least 4 years of experience as a Data Engineer.
• Strong proficiency in building API endpoints using Python or TypeScript.
• Familiarity with cloud platforms and CI/CD pipelines.

Responsabilidades

• Design and optimize data pipelines for audiovisual data processing.
• Maintain and scale cloud-based data platforms.
• Collaborate with cross-functional teams.

Conocimientos

Data Pipeline Design

API Development

SQL

Python

NoSQL

Event-Driven Architecture

Cloud Platforms (AWS, GCP, Azure)

Data Quality Governance

Herramientas

Kafka

RabbitMQ

Pinecone

ElasticSearch

FastAPI

Nest.js

Airflow

Prefect

Kubeflow

TensorFlow

PyTorch

Keras

Descripción del empleo

We are looking fora Senior Data Engineer to join the AI Team at a leader in the audiovisual industry and will workclosely with data scientists, ML engineers and fact-checkers to design the next generation of intelligent systems that can automatically verify information and make a meaningful impact in the fight against misinformation.

Responsibilities

• Design and optimize data pipelines for audiovisual data processing.
• Maintain and scale cloud-based data platforms.
• Collaborate with cross-functional teams to deliver data-driven solutions.

Key Requirements

• At least 4 years of experience as a Data Engineer.
• Strong proficiency in building API endpoints using Python (FastAPI) or TypeScript (Nest.js).
• Expertise in SQL (MariaDB) and NoSQL (MongoDB) database design and maintenance.
• Familiarity with event-driven architectures (Kafka, RabbitMQ, NATS, etc.).
• Knowledge of cloud platforms (AWS, GCP, Azure) and CI / CD pipelines.
• Hands-on experience with vector databases (Pinecone, ElasticSearch, FAISS).
• Understanding of data quality and governance best practices.
• Strong proficiency in SQL and Python.
• Ability to work in a fast-paced, collaborative environment.
• Language : Fluent in Spanish and English.

Nice to Have

• You are knowledgeable about modern data architecture patterns (e.g., data mesh, medallion architecture...)
• Your are familiar with workflow orchestration tools like Airflow, Prefect or Kubeflow.
• You have experience with deep learning frameworks (e.g., PyTorch, TensorFlow, Keras).

What We Offer

• An exciting role in a fast-growing industry.
• Full remote work, with the option to join a coworking space at our headquarters if you're based in Madrid.
• Offsites and team-building activities that foster collaboration and strengthen team bonds.
• A positive work environment where your work truly matters.

J-18808-Ljbffr