Data Engineer-Data Platforms-Azure

International Business Machines Corporation

Bengaluru

Presencial

INR 900.000 - 1.800.000

Jornada completa

Hace 2 días
Sé de los primeros/as/es en solicitar esta vacante

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

IBM Consulting in Bengaluru is seeking a Data Engineer specializing in Data Platforms on Azure to design, build, and operate batch and real-time data pipelines. You will work with Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub to deliver scalable data solutions.

You will apply Azure proficiency across data platform components, open source tooling like Apache Airflow and dbt, and help optimize data pipelines in a collaborative environment across industries.

Formación

  • Experience designing, building, and operating batch and real-time data pipelines on Azure.
  • Proficiency with Azure data platform components such as ADLS2, Blob Storage, Synapse Analytics, Spark and SQLDW.
  • Experience with open source tools like Apache Airflow and dbt, Spark in Python/Scala.
  • Ability to operate and optimize Azure services including Event Hub and Kafka streaming.
  • Familiarity with data modeling and data governance concepts.

Responsabilidades

  • Design, build, and operate data pipelines on Azure using Synapse Analytics, Data Factory, DataBricks, and Event Hub.
  • Develop and manage the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.
  • Apply Azure expertise across data platform components (ADLS2, Blob Storage, Purview).
  • Implement open source tools like Airflow and dbt to support data engineering.
  • Operate Azure services such as Event Hub, Streaming Analytics, and Kafka-based services.

Conocimientos

Azure data pipelines
Batch & real-time processing
Cloud computing

Educación

Master's Degree

Herramientas

Azure Synapse Analytics
Azure Data Factory
Azure DataBricks
Event Hub
Apache Airflow
dbt
Spark
Python
Scala
Azure Purview
Cosmos DB

Descripción del empleo

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.


Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.


Your Role And Responsibilities

As a Data Engineer specializing in Data Platforms on Azure, you will advise on, develop, and maintain data engineering solutions on the Azure Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various Azure services.


Your Primary Responsibilities Will Include


  • Design and Build Data Pipelines: Design, build, and operate batch and real-time data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub.

  • Develop Data Layer: Design, build, and operate the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

  • Apply Azure Expertise: Apply proficiency in Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.

  • Implement Open Source Technologies: Implement open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.

  • Operate Azure Services: Operate Azure services such as Azure Event Hub and Streaming Analytics, Managed Streaming for Apache Kafka, and Azure DataBricks with Spark.


Preferred Education

Master's Degree


Required Technical And Professional Expertise


  • Exposure to Azure Toolset: Experience working with Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub to design, build, and operate batch and real-time data pipelines.

  • Proficiency in Azure Data Platform: Exposure to Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.

  • Data Pipeline Development: Experience working with batch and real-time data pipelines using Azure services, including designing, building, and operating data pipelines.

  • Open Source Technologies: Exposure to open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.

  • Azure Services Operation: Experience working with Azure services such as Azure Event Hub and Streaming Analytics, Managed Streaming for Apache Kafka, and Azure DataBricks with Spark.


Preferred Technical And Professional Experience


  • Proficiency in Open Source Technologies: Exposure to open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.

  • Knowledge of Azure Services: Experience working with Azure services such as Azure Event Hub and Streaming Analytics, Managed Streaming for Apache Kafka, and Azure DataBricks with Spark.

  • Familiarity with Data Pipeline Development: Exposure to designing, building, and operating batch and real-time data pipelines using Azure services.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Data Engineer-Data Platforms-Azure
Data Engineer-Data Platforms-Azure

Spore N Sprouts • Bengaluru

Presencial
INR 1.500.000 - 2.100.000
Data Engineer-Data Platforms-AWS
Data Engineer-Data Platforms-AWS

International Business Machines Corporation • Bengaluru

Híbrido
INR 1.200.000 - 2.400.000
Data Engineer-Data Platforms-AWS
Data Engineer-Data Platforms-AWS

International Business Machines Corporation • Bengaluru

Presencial
INR 1.400.000 - 2.400.000
Data Engineer
Data Engineer

Techcarrot • Chennai

Presencial
INR 1.500.000 - 2.100.000
Data Engineer-Data Platforms-Databricks
Data Engineer-Data Platforms-Databricks

International Business Machines Corporation • Kolkata

Presencial
INR 1.200.000 - 1.600.000
Senior Big Data Engineer - I
Senior Big Data Engineer - I

Mployee.me • Pune District

Presencial
INR 3.500.000 - 7.000.000
Senior Data Engineer
Senior Data Engineer

QUESTK2 Technologies • Hyderabad

Híbrido
INR 1.400.000 - 2.300.000
Data Engineer – Azure Data Platforms
Data Engineer – Azure Data Platforms

Arvillium • Pune District

Presencial
INR 1.200.000 - 2.400.000
Azure Data Engineer
Azure Data Engineer

Saisystems Technology • Pune District, Mumbai, Gurugram District

Híbrido
INR 2.400.000 - 4.200.000
Data and Analytics engineering lead
Data and Analytics engineering lead

Orbia Pune • Pune District

Presencial
INR 4.000.000 - 7.000.000