Senior Data Engineer

INNOCV Solutions S.L.U.; Madrid; Presencial; EUR 40.000 - 80.000; Jornada completa

Descripción de la vacante

Join a forward-thinking company that thrives on technology challenges and operational excellence. In this role, you will design scalable architectures for Data Lakes and Warehouses, ensuring data quality and accessibility. You will implement ETL processes and manage both relational and non-relational databases while utilizing cloud technologies like AWS and Azure. With a strong emphasis on innovation, this organization values continuous learning and offers numerous benefits to support your professional growth and work-life balance. If you are passionate about technology and eager to make an impact, this opportunity is perfect for you.

Servicios

Flexible hours

Special timetable: Fridays and summer 7h

Individual budget for attending forums and training

Health insurance

6 extra days off every three years

Day off on your birthday

Bring a friend and benefit from it

Flexible compensation

Wellness - Gympass

Volunteering opportunities

Formación

• Experience with ETL tools and cloud platforms like AWS and Azure.
• Proficiency in programming and database design for data management.

Responsabilidades

• Design and build scalable architectures for Data Lakes and Warehouses.
• Implement and manage ETL processes and ensure data quality.

Conocimientos

ETL processes

Cloud computing

Database design

Python

Java

Scala

Kafka Streams

Apache Flink

ksqlDB

Data governance

DevOps tools

API development

Herramientas

AWS

Azure

DataBricks

SQL Server

Couchbase

MongoDB

Kafka

Confluent

Dynatrace

Grafana

Descripción del empleo

We are a company expert in helping others grow through our technological expertise, solving complex technological challenges, and focusing on operational excellence.

Since 2012, we have grown annually at an average rate of 30%, and for three consecutive years, we have been one of the fastest-growing companies in Europe according to the Financial Times.

• We are digital natives and technology-neutral thanks to our rapid adaptation capabilities and problem-solving skills in any business situation.
• We are passionate about technology challenges that have a significant impact on business. To address these, we have high-performance teams and the ability to quickly and effectively combine technologies.
• We support our clients in their digital evolution to achieve maximum efficiency in their businesses, leveraging our extensive multi-sector experience.

What will you do?

The work focuses on designing and building scalable architectures for Data Lakes and Data Warehouses to centralize and ensure the quality and accessibility of data. It involves implementing and managing ETL processes to extract, transform, and load data from multiple sources, including platforms like Sitetracker, SAP, and Smartmeters. Advanced techniques are applied to transform and enrich data, ensuring alignment with business requirements. The infrastructure is primarily cloud-based, utilizing AWS, Azure, and DataBricks for distributed data processing. Data security measures such as encryption, access controls, and threat monitoring are implemented to protect sensitive information.

Additionally, the work encompasses managing both relational and non-relational databases (e.g., SQL Server, Couchbase, MongoDB) and implementing real-time data processing technologies like Kafka Streams, Apache Flink, and ksqlDB. Event streaming platforms, such as Kafka and Confluent, are designed to enable real-time data integration. APIs are developed to facilitate efficient data flow between systems, while microservices architecture using frameworks like Spring Boot ensures scalability. Monitoring systems like Dynatrace and Grafana are set up to track the health and performance of platforms, with error-handling mechanisms, such as DLQ, ensuring data reliability. Data governance policies are defined to maintain data quality, integrity, and compliance with regulations.

What do we value?

• Experience with ETL tools and techniques.
• Advanced knowledge in cloud computing, especially AWS, Azure, and DataBricks.
• Design and modeling of relational and non-relational databases.
• Proficiency in programming languages such as Python, Java, and Scala.
• Experience with Kafka Streams, Apache Flink, and ksqlDB.
• Knowledge of data governance principles and practices.
• Familiarity with DevOps tools and CI/CD.
• Development and integration of APIs.

If you are someone who likes to stay updated on the latest trends, is eager to try new technologies, and enjoys finding alternative ways to do things, this is the place for you. If you consider yourself a team player who advocates for Fair Play above all, a team is waiting for you!

What do we offer you?

In this company, you can be yourself and work with colleagues equally passionate about technology and innovation, ready to support you at all times. We want to see you evolve and grow with us. To that end, we invest in your professional development with training, tech breakfasts, and attendance at forums. We are advocates of continuous learning, which is why we provide a personal budget for staying up to date with market trends.

We care about well-being and happiness at work, which is why we listen to needs to offer the best working conditions in a unique human environment. Due to the emphasis we place on flexibility and work-life balance, we won the Madrid Flexible Company Award in 2020 and received an honorable mention in 2022.

This is a WIN-WIN, and we have 42 benefits to offer you, but here are some highlights:

• Flexible hours
• Special timetable: Fridays and summer 7h.
• Individual budget for attending forums and training
• Health insurance
• Every three years, 6 extra days off.
• Day off on your birthday
• Bring a friend and benefit from it
• Flexible compensation
• Wellness - Gympass
• Volunteering opportunities
• Company events and team buildings

To learn more about us, the protagonists of INNOCV will share more about the company.

If you identify with our work philosophy and share our passion for INNOvation and Code Vocation, we want to meet you!

We are committed to supporting the LGTBIQ+ community and invite individuals with disabilities to apply for this position. We value diversity and are committed to inclusion in our team.