Data engineer in high-volume systems

BETWEEN Group; Barcelona; Híbrido; EUR 60.000 - 90.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Health insurance with Alan

Training opportunities

Lots of events

Flexible compensation

Incentives for referring talent

Descripción de la vacante

BETWEEN Group ищет Data Engineer для работы в технологической продуктовой команде, обрабатывающей большие объёмы данных. Вы будете проектировать ETL-процессы на Python, оптимизировать конвейеры и работать с аналитическими базами данных в облаке.

Вакансия предполагает гибридный график: 1 день в офисе в неделю, участие в Agile проектах и активное участие в технических решениях команды. Предоставляются обучение, сетевые мероприятия и гибкое вознаграждение.

Formación

• Опыт более 4 лет с Python и SQL в дата-средах.
• Проектирование, разработка и сопровождение ETL-процессов.
• Знания SQL: соединения, подзапросы, агрегаты, индексы, нормализация.
• Опыт работы с облачными сервисами (AWS, Google Cloud или Azure).
• Опыт работы с Airflow, Git, контейнерами (Docker), Kubernetes и Databricks.

Responsabilidades

• Разработка конвейеров обработки данных на Python.
• Оптимизация и сопровождение ETL-процессов.
• Работа с аналитическими базами и большими объёмами данных.
• Участие во внедрении Airflow и оркестрации задач.
• Разработка решений в облачных средах и поддержка CI/CD.

Conocimientos

Python

SQL

ETL

Airflow

Git

CI/CD

Docker

Kubernetes

Databricks

AWS

Herramientas

Airflow

Git

Databricks

Docker

Kubernetes

CI/CD

AWS

Descripción del empleo

Описание:

At BETWEEN, we offer you the opportunities you need to achieve your professional goals. If you want to develop your skills in IT and Engineering, this is your next destination! We provide support across a wide range of areas, including Firmware, Software, BI, Design, Project Management, and many more. We also develop bespoke technology solutions through our BETWEEN Labs. We are looking for a Data Engineer to join a technology product team that works daily with large volumes of information, developing platforms and pipelines that turn data into business decisions. If you enjoy designing ETL processes, working with Python and SQL, and are motivated to develop scalable cloud solutions, this could be your next challenge.

Задачи:

• Design and develop data pipelines using Python.
• Build, optimize, and maintain ETL processes.
• Work with analytical databases and large volumes of information.
• Participate in workflow orchestration using Airflow.
• Develop solutions deployed in cloud environments.
• Contribute to CI/CD and version control practices using Git.
• Actively participate in technical decisions within the team.
• Work in product-oriented Agile environments.

Требования:

More than 4 years of experience working with Python and SQL in data environments. Experience designing, developing, and maintaining ETL processes. Solid knowledge of SQL (joins, subqueries, aggregate functions, CTEs, indexes, primary and foreign keys, database normalization concepts). AWS (S3, Redshift, Lambda, Secrets Manager, SSO, etc.) or equivalent services in Google Cloud or Azure. Columnar databases (Redshift). Experience working with code repositories and collaborative development methodologies. Будет плюсом: Git; CI/CD; Apache Airflow; Docker and Kubernetes; Databricks

Условия:

Hybrid model with 1 day a week in the office. You will participate in high-impact technology projects involving large volumes of data. You will work with leading cloud technologies. You will be part of a collaborative environment where you can continue to grow professionally.

• Health insurance with Alan.
• Training opportunities: languages, certifications, boot camps, and much more.
• Lots of events: BETWEEN Night, paddle tennis tournament, and much more.
• Flexible compensation (restaurant, transport, childcare).
• Incentives for validating or recommending talent.