Data Engineer

IBM; Pune District; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

IBM is seeking an AWS Data Engineer - Databricks to work across Pune and Chennai locations. The role focuses on designing, building, and operating batch and real-time data pipelines using AWS services and Databricks.

You will create data layers on Redshift, Aurora, and DynamoDB and migrate data with DMS, ensuring seamless data flow and scalable solutions across multiple environments.

Qualifications

• 6 years' experience designing and developing data pipelines.
• Experience building batch and real-time data pipelines on AWS.
• Proficient with data integration and migration tasks.

Responsibilities

• Design, build, and operate batch and real-time data pipelines using AWS services.
• Create data layers on AWS Redshift, Aurora, and DynamoDB, and migrate data with DMS.

Skills

Data Pipelines

AWS Services

Batch & Real-time

Tools

AWS EMR

AWS Glue

Glue Catalog

Kinesis

Redshift

Aurora

DynamoDB

DMS

Job description

AWS Data Engineer - Databricks at Pune and Chennai location.

Your Role and Responsibilities

• 6 years' experience in Design and Develop Data Pipelines: Design, build, and operate batch and real-time data pipelines using AWS services such as AWS EMR, AWS Glue, Glue Catalog, and Kinesis, ensuring seamless integration and operation of data engineering solutions.
• Create Data Layers: Create data layers on AWS RedShift, Aurora, and DynamoDB, and migrate data using AWS DMS.