Azure Data Engineer

NTT DATA BUSINESS SOLUTIONS; Bari; In loco; EUR 55.000 - 85.000; Tempo pieno

Descrizione del lavoro

NTT Data Business Solutions is seeking an Azure Data Engineer to bridge Data Science and Data Engineering within a cloud-native context. You will work on data acquisition, transformation, and loading into data lakes to enable analytics and ML models.

The role requires 5+ years in Azure/cloud environments, knowledge of big data architectures, and experience delivering proofs-of-concept. Collaboration with analysts and solution architects is essential.

Competenze

• 5+ years of experience in cloud-native environments, with Azure preferred.
• Experience with Big Data architectures, cloud and on premise.
• Azure infrastructure and networking experience.
• Experience in building and delivering proofs-of-concept to address business needs.

Mansioni

• Support customers in Big Data projects, partnering with analysts and solution architects to understand use cases and data needs.
• Deliver data acquisition, transformations, cleansing, conversion, compression and loading into data lakes for analytics and ML workloads.
• Collaborate across teams to ensure Data Science and Data Engineering alignment.

Conoscenze

Azure data engineering

Big Data

SQL

Java

Python

Scala

Shell scripting

Agile/Kanban

Databricks

Spark

Azure Data Factory

Azure Synapse

Grafana

Prometheus

Leadership

Strumenti

Grafana

Prometheus

Databricks

Descrizione del lavoro

Job summary

The Azure Data Engineer in NTT Data knows the challenges of a cloud native environment. Is able to think outside the box finding innovative, yet simple, solutions to every day issues, and share those solutions with the rest of his team.

We are looking for an engineer that can be the bridge between Data Science and Data Engineering, having a clear understanding of both worlds.

If you are a Data Scientist looking for more experience in preparing data, or a Data Engineer with interest also in Data Science, willing to have a Kaizen approach, continuously improving technical skills and knowledge, you can be an Azure Data Engineer in NTT Datas Business Intelligence Service Line, in an environment where Japanese and European cultural elements are intertwined

Your contribution in this role

Your role as an Azure Data Engineer in NTT Data will be supporting customers in Big Data projects, working in partnership with business analysts and solution architects to understand use cases, data needs, and outcome objectives. In this role, you will deliver data acquisition, transformations and improvement, cleansing, conversion, compression, and loading of data into data lakes in order to be consumed by analytics and machine learning models.

The ideal profile

• Working experience in a cloud native environment in at least one of the 3 major public clouds (GCP/AWS/Azure), 5 years experience on Azure is preferred
• Experience and knowledge of Big Data Architectures, cloud and on premise
• Azure infrastructure and networking working experience
• Experience in building and deliver proofs-of-concept, in order to address specific business needs, using the most appropriate techniques, data sources and technologies
• Working experience in migrating workloads from on premise to cloud environment
• Experience in monitoring distributed infrastructure, using Azure tools or open source ones (es: Grafana, Prometheus)
• Proven experience in: Java, Scala, Python, and shell scripting
• SQL language knowledge
• Working experience with Agile Methodology and Kanban
• Experience in leading medium teams
• Working experience with: Apache Spark, Databricks, Azure Data Factory, Azure Synapse, and other Azure related ETL/ELT tools
• Microsoft Certification: Azure Data Engineer Associate or Azure Solutions Architect Expert

Nice to have

• Other Big Data certification, such as Cloudera, Databricks, etc. are welcome
• Experience with non Azure ETL/ELT solutions (Talend, Oracle Data Integrator, Informatica PowerCenter, etc.)
• Experience with Data Visualization solutions (PowerBI, Qlik, Tableau, etc.);

Location

Milano, Bari, Bologna, Cosenza, Napoli, Roma, Salerno, Torino, Treviso, Pisa