Azure Data Engineer

NTT; Pisa; In loco; EUR 50.000 - 70.000; Tempo pieno

Descrizione del lavoro

A leading technology company based in Pisa is seeking an Azure Data Engineer to support customers in Big Data projects. The role involves data acquisition, transformation, and loading into data lakes, requiring strong experience in cloud environments and Big Data architectures. Ideal candidates will bridge Data Science and Engineering, fostering continuous improvement in a dynamic work culture.

Competenze

• 5+ years experience in cloud environments, preferably on Azure.
• Experience in building proofs-of-concept for business needs.
• Strong knowledge in SQL and scripting languages.

Mansioni

• Supporting customers in Big Data projects.
• Deliver data acquisition, transformations, and loading into data lakes.
• Act as a bridge between Data Science and Data Engineering.

Conoscenze

Working experience in a cloud native environment

Experience in Big Data Architectures

Azure infrastructure and networking

Proven experience in Java

Experience with Agile Methodology and Kanban

Working experience with Apache Spark

Strumenti

Azure Data Factory

Databricks

SQL

Grafana

Prometheus

Descrizione del lavoro

Social network you want to login/join with:

Responsibilities

Your role as an Azure Data Engineer in NTT Data will be supporting customers in Big Data projects, working in partnership with business analysts and solution architects to understand use cases, data needs, and outcome objectives. In this role, you will deliver data acquisition, transformations and improvement, cleansing, conversion, compression, and loading of data into data lakes in order to be consumed by analytics and machine learning models.

The Azure Data Engineer in NTT Data knows the challenges of a cloud native environment,

Is able to think outside the box finding innovative, yet simple, solutions to every day issues, and share those solutions with the rest of his team.

We are looking for an engineer that can be the bridge between Data Science and Data Engineering, having a clear understanding of both worlds.

If you are a Data Scientist looking for more experience in preparing data, or a Data Engineer with interest also in Data Science, willing to have a KAIZEN approach, continuously improving technical skills and knowledge, you can be an Azure Data Engineer in NTT Data’s Business Intelligence Service Line, in an environment where Japanese and European cultural elements are intertwined

Required Skills

• Working experience in a cloud native environment in at least one of the 3 major public clouds (GCP/AWS/Azure), 5 years experience on Azure is preferred
• Experience and knowledge of Big Data Architectures, cloud and on premise
• Azure infrastructure and networking working experience
• Experience in building and deliver proofs-of-concept, in order to address specific business needs, using the most appropriate techniques, data sources and technologies
• Working experience in migrating workloads from on premise to cloud environment
• Experience in monitoring distributed infrastructure, using Azure tools or open source ones (es: Grafana, Prometheus)
• Proven experience in: Java, Scala, Python, and shell scripting
• SQL language knowledge
• Working experience with Agile Methodology and Kanban
• Experience in leading medium teams
• Working experience with: Apache Spark, Databricks, Azure Data Factory, Azure Synapse, and other Azure related ETL/ELT tools

Desired skills, experiences and certifications:

• Other Big Data certification, such as Cloudera, Databricks, etc. are welcome
• Experience with non Azure ETL/ELT solutions (Talend, Oracle Data Integrator, Informatica PowerCenter, etc.)
• Experience with Data Visualization solutions (PowerBI, Qlik, Tableau, etc.);