Databricks Expert - Data Engineer/Data Architect

NTT DATA Europe & Latam; Torino; In loco; EUR 50.000 - 80.000; Tempo pieno

Descrizione del lavoro

NTT DATA Europe & Latam is seeking a Databricks Expert to support customers in exciting Big Data projects. The ideal candidate will bridge Data Science and Data Engineering, utilizing skills in Databricks, Azure, and other Big Data technologies.

Preferred qualifications include 5 years of experience with Databricks, proficiency in Java, Scala, and Python, and Azure Certification. Locations include Torino, Milano, and other major cities in Italy.

Competenze

• 5+ years of experience with Databricks in a cloud native environment.
• Experience in leading medium teams and delivering proofs-of-concept.
• Knowledge of non-Azure ETL/ELT solutions is an advantage.

Mansioni

• Support customers in Big-Data projects and understand data needs.
• Deliver data acquisition and transformations into data lakes.
• Collaborate with business analysts and solution architects.

Conoscenze

Big Data Architectures

Java

Scala

Python

Shell scripting

SQL language knowledge

Azure infrastructure

Apache Spark

Databricks

ETL/ELT tools

Agile Methodology

Formazione

Microsoft Certification in Azure or Databricks

Strumenti

Azure Data Factory

Azure Synapse

Grafana

Prometheus

Descrizione del lavoro

The Databricks Expert in NTT Data knows the challenges of a cloud native environment and is able to think outside the box finding innovative, yet simple, solutions to everyday issues.

We are looking for an engineer/architect who can be the bridge between Data Science and Data Engineering, having a clear understanding of both worlds.

If you are a Data Scientist looking for more experience in preparing data, or a Data Engineer with interest also in Data Science, willing to have a KAIZEN approach, continuously improving technical skills and knowledge, you can be a Databricks Expert in NTT Data’s Data&Intelligence Service Line, in an environment where Japanese and European cultural elements are intertwined.

Your Contribution In This Role

In this role you will support customers in Big‑Data projects, working in partnership with business analysts and solution architects to understand use cases, data needs, and outcome objectives. You will deliver data acquisition, transformations, and improvement, cleansing, conversion, compression, and loading of data into data lakes for consumption by analytics and machine learning models.

The ideal profile

• Working experience in a cloud native environment in at least one of the 3 major public clouds (GCP/AWS/Azure), 5 years experience on Databricks is preferred
• Experience and knowledge of Big Data Architectures, cloud and on‑premise
• Azure infrastructure and networking working experience
• Experience in building and delivering proofs‑of‑concept to address specific business needs using the most appropriate techniques, data sources and technologies
• Experience in migrating workloads from on‑premise to cloud environment
• Experience in monitoring distributed infrastructure, using Azure tools or open source ones (e.g., Grafana, Prometheus)
• Proven experience in Java, Scala, Python, and shell scripting
• SQL language knowledge
• Experience in leading medium teams
• Working experience with Apache Spark, Databricks, Azure Data Factory, Azure Synapse and other Azure related ETL/ELT tools
• Microsoft Certification: at least one certification on Azure or Databricks (Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Spark Developer, Databricks Data Engineer, Databricks Machine Learning)

Nice To Have

• Working experience with Agile Methodology and Kanban
• Other Big Data certifications, such as Cloudera, Databricks, etc. are welcome
• Experience with non‑Azure ETL/ELT solutions (Talend, Oracle Data Integrator, Informatica PowerCenter, etc.)
• Experience with Data Visualization solutions (PowerBI, Qlik, Tableau, etc.)

Location

Milano, Bari, Bologna, Cosenza, Napoli, Roma, Salerno, Torino, Treviso, Pisa