Data Engineer

IBM; Chennai District; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

IBM in India is looking for a Data Engineer-Data Platforms specializing in AWS/Databricks for Chennai and Pune locations. You will design, build, and operate batch and real-time data pipelines using AWS services and Databricks.

Your role includes creating data layers on RedShift, Aurora, and DynamoDB and migrating data with DMS to ensure scalable data solutions for the business.

Qualifications

• 5+ years experience in design and development of data pipelines.
• Experience with batch and real-time data pipelines on AWS.
• Proficiency in AWS data services (EMR, Glue, Kinesis, DMS).

Responsibilities

• Design, build, and operate batch and real-time data pipelines on AWS.
• Advise on, develop, and maintain data engineering solutions in the AWS ecosystem.
• Create data layers on RedShift, Aurora, and DynamoDB and perform data migration with DMS.

Skills

AWS Data Pipelines

Data Engineering

Batch & Real-time

AWS EMR

AWS Glue

Kinesis

Databricks

Tools

AWS EMR

AWS Glue

Glue Catalog

Kinesis

RedShift

Aurora

DynamoDB

DMS

Job description

IBM is hiring for Data Engineer-Data Platforms-AWS/Databricks at Pune and Chennai location.

Your Role and Responsibilities*

As a Data Engineer specializing in Data Platforms on AWS, you will advise on, develop, and maintain data engineering solutions on the AWS Cloud ecosystem. You will design, build, and operate batch and real-time data pipelines using various AWS services. Your primary responsibilities will include:

• 5+ years experience in Design and Develop Data Pipelines: Design, build, and operate batch and real-time data pipelines using AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis, ensuring seamless integration and operation of data engineering solutions.
• Create Data Layers: Create data layers on AWS RedShift, Aurora, and DynamoDB, and migrate data using AWS DMS.