Databricks Expert - Data Engineer/Data Architect

NTT DATA, Inc.; Varese; Ibrido; EUR 90.000 - 120.000; Tempo pieno

Descrizione del lavoro

NTT DATA, Inc. seeks a Databricks Expert to bridge Data Science and Data Engineering, building cloud-native data solutions for analytics and ML.

You will deliver end-to-end data pipelines, support PoCs, and guide migrations from on-prem to cloud, collaborating with analysts and solution architects in a cross-cultural, hybrid environment.

Competenze

• 5+ years of experience with Databricks and Spark
• Strong programming skills in Java, Scala, Python, shell
• Experience leading medium-sized teams and mentoring
• Cloud-native data engineering experience on at least one major cloud (Azure, AWS, GCP)

Mansioni

• Support customers on Big Data projects and collaborate with business analysts and solution architects to understand use cases and outcomes
• Deliver data acquisition, transformations, cleansing, conversion, compression and loading into data lakes for analytics/ML consumption
• Assist in designing data pipelines and enhancements to support analytics and machine learning
• Contribute to PoCs and migration efforts from on-premise to cloud environments
• Monitor and optimize distributed infrastructure using Azure or open-source tooling
• Hands-on with Spark, Databricks, Azure Data Factory, and Azure Synapse
• Experience migrating workloads from on-prem to cloud
• Leadership and mentoring of teams

Conoscenze

Databricks

Data engineering

Team leadership

Programming

Strumenti

Azure Data Factory

Azure Synapse

Spark

Databricks

Grafana/Prometheus

Descrizione del lavoro

As a Databricks Expert at NTT DATA, you will bridge Data Science and Data Engineering to craft cloud-native data solutions. You’ll support customers on Big Data initiatives, collaborating with analysts and solution architects to align use cases with data needs and outcomes. You’ll build and optimize data pipelines, enabling analytics and machine learning through well-governed data lakes. This hybrid role places you in a cross-cultural environment, fostering continuous skill growth and impactful data-driven transformation.

• Support customers on Big Data projects and collaborate with business analysts and solution architects to understand use cases and outcomes
• Deliver data acquisition, transformations, cleansing, conversion, compression and loading into data lakes for analytics/ML consumption
• Assist in designing data pipelines and enhancements to support analytics and machine learning
• Contribute to PoCs and migration efforts from on-premise to cloud environments
• Monitor and optimize distributed infrastructure using Azure or open-source tooling
• Cloud-native experience in at least one of GCP, AWS, or Azure
• 5+ years experience with Databricks (preferred)
• Knowledge of Big Data architectures (cloud and on-premises)
• Azure infrastructure and networking experience
• Experience delivering PoCs addressing business needs with appropriate tech
• Experience migrating workloads from on-prem to cloud
• Experience monitoring distributed infrastructure (Azure tools or Grafana/Prometheus)
• Proven programming skills in Java, Scala, Python, and shell scripting
• Experience leading medium-sized teams
• Hands-on with Spark, Databricks, Azure Data Factory, and Azure Synapse
• Microsoft Certifications relevant to Azure or Databricks
• Leadership and mentoring of teams
• Strong collaboration and cross-functional communication
• Problem-solving mindset with Kaizen approach
• Databricks

Databricks Expert - Data Engineer/Data Architect varese, lombardia, it