Senior Data Engineer

INNOCV Solutions; Roma; In loco; EUR 30.000 - 50.000; Tempo pieno

Descrizione del lavoro

A leading technology consultancy in Italy is seeking a Senior Data Engineer who will design and build scalable architectures for Data Lakes and Data Warehouses. The ideal candidate must have experience with ETL processes, advanced knowledge in cloud computing (AWS, Azure, DataBricks), and proficiency in programming languages such as Python, Java, and Scala. This full-time position offers opportunities for professional development and a flexible work-life balance, aiming to enhance efficiency and effectiveness in digital transformation projects.

Servizi

Personal budget for continuous learning

Training and tech breakfasts

Flexibility for work-life balance

Competenze

• Experience with ETL tools and techniques.
• Advanced knowledge in cloud computing (AWS, Azure, DataBricks).
• Design and modeling of relational and non-relational databases.
• Proficiency in programming languages such as Python, Java, and Scala.
• Experience with Kafka Streams, Apache Flink, and ksqlDB.
• Knowledge of data governance principles and practices.
• Familiarity with DevOps tools and CI/CD.
• Development and integration of APIs.

Mansioni

• Design and build scalable architectures for Data Lakes and Data Warehouses.
• Implement and manage ETL processes to extract, transform, and load data.
• Manage both relational and non-relational databases.
• Implement real-time data processing technologies like Kafka Streams and Apache Flink.
• Set up monitoring systems to track the health and performance of platforms.

Conoscenze

ETL tools and techniques

Cloud computing (AWS, Azure, DataBricks)

Relational and non-relational databases design

Programming languages (Python, Java, Scala)

Kafka Streams

Apache Flink

ksqlDB

Data governance principles

DevOps tools and CI/CD

APIs development and integration

Descrizione del lavoro

Join to apply for the Senior Data Engineer role at INNOCV Solutions.

About the Company

We are a company expert in helping others grow through our technological expertise, solving complex technological challenges, and focusing on operational excellence. We are part of Alkemy, an international company that specializes in evolving the business model of large and medium-sized enterprises and is a public company listed on the MTA STAR market of Borsa Italiana.

• We are digital natives and technology-neutral thanks to our rapid adaptation capabilities and problem‑solving skills in any business situation.
• We are passionate about technology challenges that have a significant impact on business. To address these, we have high‑performance teams and the ability to quickly and effectively combine technologies.
• We support our clients in their digital evolution to achieve maximum efficiency in their businesses, leveraging our extensive multi‑sector experience.

Responsibilities

The work focuses on designing and building scalable architectures for Data Lakes and Data Warehouses to centralize and ensure the quality and accessibility of data. It involves implementing and managing ETL processes to extract, transform, and load data from multiple sources, including platforms like Sitetracker, SAP, and Smartmeters. Advanced techniques are applied to transform and enrich data, ensuring alignment with business requirements. The infrastructure is primarily cloud‑based, utilizing AWS, Azure, and DataBricks for distributed data processing. Data security measures such as encryption, access controls, and threat monitoring are implemented to protect sensitive information.

Additionally, the work encompasses managing both relational and non‑relational databases (e.g., SQL Server, Couchbase, MongoDB) and implementing real‑time data processing technologies like Kafka Streams, Apache Flink, and ksqlDB. Event streaming platforms, such as Kafka and Confluent, are designed to enable real‑time data integration. APIs are developed to facilitate efficient data flow between systems, while microservices architecture using frameworks like Spring Boot ensures scalability. Monitoring systems like Dynatrace and Grafana are set up to track the health and performance of platforms, with error‑handling mechanisms, such as DLQ, ensuring data reliability. Data governance policies are defined to maintain data quality, integrity, and compliance with regulations.

Qualifications

• Experience with ETL tools and techniques.
• Advanced knowledge in cloud computing, especially AWS, Azure, and DataBricks.
• Design and modeling of relational and non‑relational databases.
• Proficiency in programming languages such as Python, Java, and Scala.
• Experience with Kafka Streams, Apache Flink, and ksqlDB.
• Knowledge of data governance principles and practices.
• Familiarity with DevOps tools and CI/CD.
• Development and integration of APIs.

What We Value

We value people who stay updated on the latest trends, are eager to try new technologies, and enjoy finding alternative ways to do things. We value team players who advocate for fair play above all.

Benefits

In this company, you can be yourself and work with colleagues equally passionate about technology and innovation. We invest in your professional development with training, tech breakfasts, and forums, and provide a personal budget for continuous learning. We care about well‑being and happiness at work, listening to needs to offer the best working conditions and flexibility for work‑life balance.

Job Details

Seniority level: Mid‑Senior level.
Employment type: Full‑time.
Job function: Information Technology.
Industries: Software Development.

Suitable profiles will be contacted within 20 days. Applications without a complete CV attached will not be considered. Candidate data will be processed in accordance with the Privacy Notice, which is always available on our website.

Referrals increase your chances of interviewing at INNOCV Solutions by 2x.