Data Engineer-Data Platforms-Azure

International Business Machines Corporation

New Delhi

Presencial

INR 1.200.000 - 1.800.000

Jornada completa

Hace 4 días
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

IBM Consulting is seeking a Data Engineer specializing in Data Platforms on Azure to design, build, and maintain batch and real-time data pipelines using Azure services.

You will design, develop, and operate data layers on Azure Synapse Analytics, SQL DW, and Cosmos DB, leveraging Apache Airflow, dbt, Spark, and Python to deliver scalable data solutions in a collaborative environment.

Formación

  • Required Azure toolset proficiency: Synapse Analytics, Data Factory, DataBricks, Event Hub.
  • Experience with Azure Data Platform components: ADLS2, Blob Storage, SQLDW, Spark/SQL, Cosmos DB.
  • Exposure to open source technologies like Apache Airflow and dbt, Spark/Python or Spark/Scala.
  • Experience developing and maintaining data engineering solutions on Azure Cloud, batch and real-time pipelines.
  • Design, build, and operate the data layer on Azure Synapse Analytics, Cosmos DB.

Responsabilidades

  • Design, build, and operate batch and real-time data pipelines using Azure services.
  • Develop data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.
  • Implement Azure Data Platform components and manage data platform services.
  • Apply Open Source technologies (Airflow, dbt) to support data engineering solutions.
  • Ensure seamless operations of data pipelines for both batch and real-time processing.

Herramientas

Azure Synapse Analytics
Azure Data Factory
Azure DataBricks
Event Hub
ADLS2
Blob Storage
SQLDW
Cosmos DB
Apache Airflow
dbt
Python
Spark
Scala
Azure Functions
Azure Purview

Descripción del empleo

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.


Your role and responsibilities

As a Data Engineer specializing in Data Platforms on Azure, you will advise on, develop, and maintain data engineering solutions on the Azure Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various Azure services.


Your primary responsibilities will include:



  • Design and Build Data Pipelines: Design, build, and operate batch and real-time data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub.

  • Develop Data Layer: Design, build, and operate the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.

  • Implement Azure Data Platform: Implement and maintain Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.

  • Utilize Open Source Technologies: Apply proficiency in open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.

  • Ensure Seamless Operations: Operate and maintain data engineering solutions to ensure seamless batch and real-time data processing.


Required technical and professional expertise


  • Exposure to Azure Toolset: Proficiency in Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub to design, build, and operate batch and real-time data pipelines.

  • Data Engineering on Azure: Experience working with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.

  • Open Source Technologies: Exposure to open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.

  • Data Pipeline Development: Experience developing and maintaining data engineering solutions on the Azure Cloud ecosystem, including designing, building, and operating batch and real-time data pipelines.

  • Azure Data Layer Design: Experience designing, building, and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.


Preferred technical and professional experience


  • Proficiency in Azure Services: Exposure to Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub to design, build, and operate batch and real-time data pipelines.

  • Open Source Technologies: Exposure to open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.

  • Data Engineering on Azure: Experience working with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.


IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Data Engineer-Data Platforms-Azure
Data Engineer-Data Platforms-Azure

International Business Machines Corporation • Coimbatore

Presencial
INR 1.200.000 - 1.800.000
Data Engineer-Data Platforms-Azure
Data Engineer-Data Platforms-Azure

International Business Machines Corporation • Delhi

Presencial
INR 1.500.000 - 2.100.000
Data Engineer-Data Platforms-Azure
Data Engineer-Data Platforms-Azure

International Business Machines Corporation • Gurugram District

Presencial
INR 1.800.000 - 2.400.000
Data Engineer-Data Platforms-Azure
Data Engineer-Data Platforms-Azure

International Business Machines Corporation • Kochi

Presencial
INR 1.800.000 - 2.800.000
Data Engineer-Data Platforms-Azure
Data Engineer-Data Platforms-Azure

International Business Machines Corporation • Noida

Presencial
INR 1.200.000 - 2.100.000
Data Engineer-Data Platforms-Azure
Data Engineer-Data Platforms-Azure

International Business Machines Corporation • Bengaluru

Presencial
INR 900.000 - 1.800.000
Data Engineer - Azure Data Platforms
Data Engineer - Azure Data Platforms

Ibm India Private Limited • Bengaluru

Híbrido
INR 1.800.000 - 3.200.000
Application Developer-Microsoft Cloud
Application Developer-Microsoft Cloud

International Business Machines Corporation • Bengaluru

Presencial
INR 1.400.000 - 2.400.000
Application Architect-Microsoft Analytics & Cloud
Application Architect-Microsoft Analytics & Cloud

International Business Machines Corporation • Bengaluru

Presencial
INR 1.800.000 - 3.400.000
Data Engineer-Data Platforms
Data Engineer-Data Platforms

International Business Machines Corporation • New Delhi

Presencial
INR 900.000 - 1.600.000