(Senior) Data Engineer (m / f / d)

Schustermann & Borenstein GmbH; Málaga; Presencial; EUR 40.000 - 80.000; Jornada completa

Descripción de la vacante

An innovative company is looking for a skilled Data Engineer to develop and maintain ETL processing pipelines for batch and near-real-time data. This role involves designing and extending an enterprise data warehouse, extracting data from various sources, and automating pipeline generation. You will work with modern tools like Airflow and Kubernetes, while also being part of a diverse and inclusive environment. With flexible hybrid or full remote work options and an attractive salary package, this opportunity is perfect for those looking to thrive in a dynamic team and contribute to exciting projects.

Servicios

Flexible work options

30 days of vacation

Employee discounts

Inclusive work environment

Thorough induction process

Formación

• Experience in developing ETL pipelines and data warehousing.
• Strong knowledge of SQL and proficiency in Python.

Responsabilidades

• Design and implement enterprise data warehouse for analytics.
• Extract data from various sources and maintain ETL pipelines.

Conocimientos

SQL

Python

Linux

Data Engineering

ETL Pipelines

Cloud Data Architectures

Communication Skills

Educación

Bachelor's degree in Computer Science

Equivalent experience in a quantitative field

Herramientas

Airflow

Kubernetes

Starburst

dbt

Kafka

GitLab

Descripción del empleo

Job Description: Data Engineer

We are seeking a skilled Data Engineer to develop and maintain ETL processing pipelines for batch and near-real-time data, as well as support analytical and machine learning workflows.

Responsibilities:

1. Design, implement, and extend our enterprise data warehouse to support analytics and data-driven decision-making.
2. Extract data from various sources, including transactional databases, third-party tools, and APIs such as Google Analytics (BigQuery), Google AdWords, Salesforce, MSSQL, among others.
3. Develop and maintain ETL pipelines using modern tools like Airflow, Kubernetes, Starburst, dbt, and Kafka.
4. Automate pipeline generation and extension through code that writes code.
5. Maintain and expand CI/CD pipelines, utilizing GitLab for automated testing and deployment.

Qualifications:

• Bachelor's degree in a quantitative field such as computer science, physics, mathematics, engineering, or equivalent experience.
• Profound knowledge of SQL, especially with dbt; understanding of RDBMS and columnar database concepts is a plus.
• Proficiency in Python and Linux platforms; familiarity with Airflow is advantageous.
• Experience with cloud data architectures (AWS or Azure) is preferred.
• Willingness to learn and stay updated with relevant technologies.
• Strong team player with the ability to work independently and improve processes.
• Excellent English communication skills; German language skills are a plus.

What We Offer:

• Flexible hybrid or full remote work options.
• Inclusive and diverse work environment.
• Attractive salary package and 30 days of vacation.
• Great employee discounts and a motivated team.
• Thorough induction process.

Become part of our success story and work in an innovative environment at BestSecret, where diversity is celebrated and your talents can thrive.