Data Engineer

ClearPeaks; Barcelona; Presencial; EUR 40.000 - 60.000; Jornada completa

Descripción de la vacante

A specialist consulting firm is seeking a Data Engineer to enhance data pipelines and transfer data securely across environments. Responsibilities include developing and managing data pipelines and consulting on architectural design. Candidates should hold a degree in a relevant field and have proven experience with Python, Scala, and orchestration tools. The role offers an attractive salary and a flexible working environment.

Servicios

Work with leading-edge technologies

Excellent work environment

International and ambitious team

Attractive salary and flexible compensation

Formación

• A degree in a relevant field is required.
• Proven experience with Python or Scala is essential.
• Experience with orchestration tools like Airflow or Oozie is a must.

Responsabilidades

• Develop, deploy, and manage data pipelines following CI/CD practices.
• Orchestrate data pipelines using tools such as Airflow and Azure Data Factory.
• Consult on best architectural and design principles in developing pipelines.

Conocimientos

Python

Scala

SQL

Data Ingestion

Cloud Platforms (AWS, Azure, GCP)

CI / CD

Data Pipeline Orchestration

Educación

Degree in Statistics, Computer Science, Telecommunication Engineering, Informatics

Herramientas

Airflow

Azure Data Factory

Oozie

Git

KNIME

Descripción del empleo

ClearPeaks is a specialist consulting firm delivering services and solutions in "Everything Data" - Business Intelligence, Advanced Analytics, Big Data & Cloud, and Web & Mobile Applications. Founded in 2000, we have been a trusted partner to our customers in over 15 industry verticals and functional areas, with operations spanning Europe, Middle East, the United States, and Africa.

ClearPeaks is part of a strategic alliance with synvert, a group of six successful full-service Data & Analytics (D&A) consulting firms, with a goal to become one of EMEA's largest D&A consulting companies.

Our services are based on the latest market-leading enterprise technology platforms, delivered by a dynamic team of expert consultants. Our strength lies in our ability to efficiently deliver customer insight and value, gained through our decades of experience with real-world challenges.

As a Data Engineer, you will be responsible for securely transferring data between different network domains and environments. Additionally, you will improve the performance and enhance the structure of data pipelines and data models.

At ClearPeaks, there are endless opportunities to get involved in various projects, bringing innovative ideas while being part of leading-edge teams who are always innovating and evolving in the Data Management field.

Responsibilities

• Develop, deploy, and manage data pipelines following CI / CD practices.
• Orchestrate data pipelines with tools such as Airflow, Oozie, Azure Data Factory, etc.
• Develop Python scripts or Scala code for data processing.
• Collect and analyze pipeline requirements.
• Consult on best architectural and design principles in developing pipelines.

Requirements

• A degree in Statistics, Computer Science, Telecommunication Engineering, Informatics, or a related field.
• Proven experience with Python or Scala.
• Experience with orchestration tools like Airflow or Oozie.
• Ability to use CI / CD & DevOps tools such as Git, AWS CI / CD Pipelines, Azure DevOps, etc.
• Knowledge of SQL.
• KNIME knowledge is a plus.
• Ability to solution for data ingestion, cleansing, ETL, data mart creation, and exposing data for consumers.
• Experience with cloud data platforms in AWS, Azure, or GCP.

Our offer to you!

• Work with leading-edge technologies to accelerate your career development.
• Enjoy an excellent work environment where people love what they do.
• Be part of an international and ambitious team while having fun.
• Attractive salary and flexible compensation.