Data Engineer

ClearPeaks; Málaga; Presencial; EUR 30.000 - 60.000; Jornada completa

Descripción de la vacante

Una empresa de consultoría especializada busca un Ingeniero de Datos para unirse a su equipo dinámico. En esta emocionante posición, serás responsable de transferir datos de manera segura entre diferentes dominios de red y mejorar el rendimiento de los pipelines de datos. Trabajarás con tecnologías de vanguardia y tendrás la oportunidad de participar en proyectos innovadores que impactan en el campo de la gestión de datos. Si te apasiona la tecnología y deseas formar parte de un equipo internacional ambicioso, esta es la oportunidad perfecta para impulsar tu carrera y disfrutar de un ambiente laboral excepcional.

Servicios

Ambiente de trabajo excelente

Desarrollo profesional acelerado

Equipo internacional y ambicioso

Salario atractivo y compensación flexible

Formación

• Experiencia comprobada en Python o Scala para procesamiento de datos.
• Conocimientos en herramientas de orquestación como Airflow o Oozie.

Responsabilidades

• Desarrollar y gestionar pipelines de datos siguiendo prácticas CI/CD.
• Orquestar pipelines de datos con herramientas como Airflow y Azure Data Factory.

Conocimientos

Python

Scala

SQL

Data Ingestion

Data Cleansing

ETL

Data Mart Creation

Data Analysis

Educación

Grado en Estadística

Grado en Informática

Grado en Ingeniería de Telecomunicaciones

Herramientas

Airflow

Oozie

Azure Data Factory

Git

AWS CI/CD Pipelines

Azure DevOps

KNIME

Descripción del empleo

ClearPeaks is a specialist consulting firm delivering services and solutions in "Everything Data" - Business Intelligence, Advanced Analytics, Big Data & Cloud, and Web & Mobile Applications. Founded in 2000, we have been a trusted partner to our customers in over 15 industry verticals and functional areas, with operations spanning Europe, Middle East, the United States, and Africa.

ClearPeaks is part of a strategic alliance with synvert, a group of six successful full-service Data & Analytics (D&A) consulting firms, with a clear goal to become one of EMEA's largest D&A consulting companies.

Our services are based on the latest market-leading enterprise technology platforms, and delivered by a dynamic team of expert consultants. Our strength lies in our ability to efficiently deliver customer insight and value, gained through our decades of experience with real-world challenges.

As a Data Engineer, you will be responsible for securely transferring the data between different network domains and environments. You will also be improving the performance and enhancing the structure of the data pipelines and data models.

At ClearPeaks, there are endless opportunities to get involved in different projects bringing innovative ideas while being part of leading-edge teams who are always innovating and evolving in the Data Management field.

Responsibilities

• Develop, deploy and manage data pipelines following CI / CD practices.
• Orchestrate data pipelines with tools such as Airflow, Oozie, Azure Data Factory, etc.
• Develop Python scripts or Scala code for data processing.
• Collect and analyse pipeline requirements.
• Consult about best architectural and design principles in developing pipelines.

Requirements

• A degree in Statistics, Computer Science or Telecommunication Engineering, Informatics or related degree.
• Proven experience with Python or Scala.
• Experience with orchestration tools like Airflow or Oozie.
• Ability to use CI / CD & DevOps tools such as Git, AWS CI / CD Pipelines, Azure DevOps, etc.
• Knowledge of SQL.
• KNIME knowledge is nice to have.
• Ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers.
• Technology expertise of solutioning in cloud data platforms in AWS, Azure or GCP.

Our offer to you!

• Work with leading edge technologies that will enable you to accelerate your career development.
• Enjoy an excellent work environment where people love what they do.
• Be part of an international and ambitious team whilst having fun.
• Attractive salary and flexible compensation.