Databricks Expert - Data Engineer/Data Architect

Ntt Data Italia; Ala; On-site; EUR 70,000 - 110,000; Full time

Job summary

NTT DATA Italia è alla ricerca di un Databricks Expert per guidare progetti Big Data in ambienti cloud ibridi. Il candidato lavorerà a stretto contatto con analisti di business e solution architect per definire casi d'uso, requisiti dati e obiettivi di outcome, fornendo soluzioni di trasformazione, pulizia e caricamento in data lake per supportare analisi e modelli ML.

È richiesta esperienza con Databricks, Spark, Azure Data Factory e Synapse, competenze in Java/Scala/Python, nonché capacità di

Qualifications

• Esperienza in ambienti cloud pubblici (GCP/AWS/Azure) e 5+ anni con Databricks.
• Conoscenza architetture Big Data, cloud e on-premise.
• Esperienza nella creazione di proof-of-concepts per esigenze di business.
• Esperienza migrazione workload da on premise al cloud.
• Monitoraggio infrastrutture distribuite con strumenti Azure o open source (Grafana/Prometheus).
• Competenze in Java, Scala, Python e shell scripting.
• Conoscenza di SQL e dati strutturati.
• Leadership di team di medie dimensioni.
• Esperienza con Apache Spark, Databricks, Azure Data Factory, Azure Synapse e altri ETL/ELT su Azure.
• Certificazione Microsoft: almeno una certificazione in Azure o Databricks.

Responsibilities

• Supportare i clienti in progetti Big Data in collaborazione con analisti di business e solution architect.
• Fornire acquisizione, trasformazione, pulizia e caricamento dati in data lake per analisi e modelli ML.

Skills

Databricks

Java

Python

Scala

SQL

Shell scripting

Big Data architectures

Cloud native

Grafana

Prometheus

Tools

Azure Data Factory

Azure Synapse

Databricks

Job description

Questa posizione è in NTT Data Italia

Il processo di selezione sarà interamente gestito NTT Data Italia.

The Databricks Expert in NTT Data knows the challenges of a cloud native environment and is able to think outside the box finding innovative, yet simple, solutions to everyday issues. We are looking for an engineer/architect who can be the bridge between Data Science and Data Engineering, having a clear understanding of both worlds. If you are a Data Scientist looking for more experience in preparing data, or a Data Engineer with interest also in Data Science, willing to have a KAIZEN approach, continuously improving technical skills and knowledge, you can be a Databricks Expert in NTT Data’s Data&Intelligence Service Line, in an environment where Japanese and European cultural elements are intertwined

Your contribution in this role:

Your role as a Databricks Expert in NTT Data will include supporting customers in Big Data projects, working in partnership with business analysts and solution architects to understand use cases, data needs, and outcome objectives. In this role, you will deliver data acquisition, transformations and improvement, cleansing, conversion, compression, and loading of data into data lakes in order to be consumed by analytics and machine learning models.

The ideal profile

• Working experience in a cloud native environment in at least one of the 3 major public clouds (GCP/AWS/Azure), 5 years experience on Databricks is preferred
• Experience and knowledge of Big Data Architectures, cloud and on premise
• Azure infrastructure and networking working experience
• Experience in building and deliver proofs-of-concept, in order to address specific business needs, using the most appropriate techniques, data sources and technologies
• Working experience in migrating workloads from on premise to cloud environment
• Experience in monitoring distributed infrastructure, using Azure tools or open source ones (es: Grafana, Prometheus)
• Proven experience in: Java, Scala, Python, and shell scripting
• SQL language knowledge
• Experience in leading medium teams
• Working experience with: Apache Spark, Databricks, Azure Data Factory, Azure Synapse, and other Azure related ETL/ELT tools
• Microsoft Certification: at least one certification on Azure or Databricks (Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Spark Developer, Databricks Data Engineer, Databricks Machine Learning)

Nice to have:

• Working experience with Agile Methodology and Kanban
• Other Big Data certifications, such as Cloudera, Databricks, etc. are welcome
• Experience with non Azure ETL/ELT solutions (Talend, Oracle Data Integrator, Informatica PowerCenter, etc.)
• Experience with Data Visualization solutions (PowerBI, Qlik, Tableau, etc.);

Location:

Milano, Bari, Bologna, Cosenza, Napoli, Roma, Salerno, Torino, Treviso, Pisa

Build your future with NTT DATA.

Join a global company, a leader in business and technology services, that listens to your voice and recognizes the value of your work. You will collaborate with clients, partners, and colleagues from all over the world to create innovative solutions capable of making a real impact on society. Here, you will have the opportunity to develop new skills and expand your network. We are present in Italy with over 6,000 employees across our offices in Milan, Rome, Turin, Genoa, Bologna, Treviso, Pisa, Padua, Naples, Cosenza, Bari, and Salerno. Make this the place where you grow.

Join us!