Data Engineer-Data Platforms-Azure

International Business Machines Corporation

Kochi

On-site

INR 1,800,000 - 2,800,000

Full time

5 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

IBM Consulting seeks a Data Engineer specializing in Azure data platforms to advise on, develop, and maintain data engineering solutions on the Azure Cloud. You will design, build, and operate batch and real-time data pipelines using Azure services.

You will work with lead Azure components—Synapse Analytics, Data Factory, DataBricks, Event Hub, Cosmos DB—and apply open source tools like Airflow and dbt to support scalable data engineering solutions. Master's degree preferred.

Qualifications

  • Exposure to Azure toolset including Synapse Analytics, Data Factory, DataBricks and Event Hub.
  • Experience with Azure data platform components such as ADLS2, Blob Storage, Cosmos DB, and SQLDW.
  • Open source tech familiarity with Airflow and dbt, plus Spark with Python or Scala.
  • Proven track record designing, building and operating batch and real-time data pipelines.

Responsibilities

  • Design, build and operate batch and real-time data pipelines on Azure.
  • Develop data layer on Azure Synapse Analytics, SQL DW and Cosmos DB.
  • Implement and maintain Azure Data Platform components including ADLS2 and Purview.
  • Apply open source tools like Airflow and dbt to data engineering solutions.
  • Ensure seamless data processing operations across the Azure cloud.

Skills

Azure data pipelines
Batch and real-time processing
Data platforms on Azure
Open source: Airflow
Python
Spark
dbt
Azure Synapse Analytics
Azure Data Factory
Azure DataBricks
Cosmos DB
Event Hub

Education

Master's Degree

Tools

Azure Synapse Analytics
Azure Data Factory
Azure DataBricks
Event Hub
Cosmos DB
Azure Purview
Apache Airflow
dbt

Job description

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Introduction

A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.

Your Role And Responsibilities

As a Data Engineer specializing in Data Platforms on Azure, you will advise on, develop, and maintain data engineering solutions on the Azure Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various Azure services.

Your Primary Responsibilities Will Include
  • Design and Build Data Pipelines: Design, build, and operate batch and real-time data pipelines using Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub.
  • Develop Data Layer: Design, build, and operate the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.
  • Implement Azure Data Platform: Implement and maintain Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.
  • Utilize Open Source Technologies: Apply proficiency in open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.
  • Ensure Seamless Operations: Operate and maintain data engineering solutions to ensure seamless batch and real-time data processing.
Preferred Education

Master's Degree

Required Technical And Professional Expertise
  • Exposure to Azure Toolset: Proficiency in Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub to design, build, and operate batch and real-time data pipelines.
  • Data Engineering on Azure: Experience working with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.
  • Open Source Technologies: Exposure to open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.
  • Data Pipeline Development: Experience developing and maintaining data engineering solutions on the Azure Cloud ecosystem, including designing, building, and operating batch and real-time data pipelines.
  • Azure Data Layer Design: Experience designing, building and operating the data layer on Azure Synapse Analytics, SQL DW, and Cosmos DB.
Preferred Technical And Professional Experience
  • Proficiency in Azure Services: Exposure to Azure services such as Azure Synapse Analytics, Azure Data Factory, Azure DataBricks, and Event Hub to design, build, and operate batch and real-time data pipelines.
  • Open Source Technologies: Exposure to open source technologies like Apache Airflow and dbt, Spark / Python, or Spark / Scala to support data engineering solutions.
  • Data Engineering on Azure: Experience working with Azure Data Platform components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure Purview, and Cosmos DB.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer-Data Platforms-Azure
Data Engineer-Data Platforms-Azure

International Business Machines Corporation • Bengaluru

On-site
INR 900,000 - 1,800,000
Data Engineer-Data Platforms-Azure
Data Engineer-Data Platforms-Azure

International Business Machines Corporation • Coimbatore

On-site
INR 900,000 - 1,350,000
Data Engineer-Data Platforms-AWS
Data Engineer-Data Platforms-AWS

International Business Machines Corporation • Bengaluru

Hybrid
INR 1,200,000 - 2,400,000
Data Engineer-Data Platforms-AWS
Data Engineer-Data Platforms-AWS

International Business Machines Corporation • Bengaluru

On-site
INR 1,400,000 - 2,400,000
Senior Data Engineer
Senior Data Engineer

QUESTK2 Technologies • Hyderabad

Hybrid
INR 1,400,000 - 2,300,000
Data Engineer – Azure Data Platforms
Data Engineer – Azure Data Platforms

Arvillium • Pune District

On-site
INR 1,200,000 - 2,400,000
Data Engineer-Data Platforms-Databricks
Data Engineer-Data Platforms-Databricks

International Business Machines Corporation • Kochi

On-site
INR 1,200,000 - 1,800,000
Data Engineer
Data Engineer

Techcarrot • Chennai

On-site
INR 1,500,000 - 2,100,000
Azure Data Engineer
Azure Data Engineer

Saisystems Technology • Pune District, Mumbai, Gurugram District

Hybrid
INR 2,400,000 - 4,200,000
Senior Big Data Engineer - I
Senior Big Data Engineer - I

Mployee.me • Pune District

On-site
INR 3,500,000 - 7,000,000