Data Engineer – Data Platforms on AWS | IBM | Pune, Bangalore and Chennai

International Business Machines Corporation; Pune District, Bengaluru, Chennai; In loco; INR 1.600.000 - 2.800.000; Tempo pieno

Descrizione del lavoro

IBM in India is seeking a Data Engineer – Data Platforms – AWS to own advisory, development, and operations of AWS data services across Pune, Bangalore, and Chennai. You will design and implement batch and real-time pipelines using EMR, Glue, Kinesis, and migrate data with DMS.

You will create analytical data layers with Redshift, Aurora, DynamoDB; collaborate with cross-functional teams; ensure governance and security standards; and contribute to enterprise-scale data initiatives within a

Competenze

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or related field.
• 6+ years of hands-on data engineering, cloud platforms, and ETL experience.
• Strong experience with AWS data services (EMR, Glue, Kinesis).
• Experience creating analytical data layers on Redshift, Aurora, DynamoDB.
• Experience migrating data with AWS DMS.
• Proficiency in SQL and Python/Scala; strong analytics and stakeholder communication.

Mansioni

• Advise on and architect advanced data engineering solutions in AWS Cloud.
• Design, build, test, and operate batch and real-time pipelines using AWS services.
• Implement data ingestion and streaming using Kinesis and Glue.
• Configure big data environments with EMR and Glue Catalog.
• Create scalable data layers with Redshift, Aurora, DynamoDB.
• Migrate databases using AWS DMS and ensure governance and security.
• Collaborate with data scientists, software engineers, and business stakeholders.
• Maintain documentation and runbooks for data workflows.

Conoscenze

AWS data services

Python/Scala

SQL optimization

Data pipeline design

Analytical thinking

Stakeholder communication

Problem solving

Formazione

Bachelors/Masters in CS/IT/Data Eng

Master’s preferred

Strumenti

AWS EMR

AWS Glue

Glue Catalog

Kinesis

Redshift

Aurora

DynamoDB

DMS

Docker

Kubernetes

Jira

Confluence

Descrizione del lavoro

Position Summary

Driving advanced data engineering solutions, cloud data platforms, and real-time data pipelines on the AWS Cloud ecosystem across Pune, Bangalore, and Chennai, IBM is actively seeking an experienced Data Engineer – Data Platforms – AWS for a permanent full-time professional engagement. In this vital technical infrastructure role, you will take full operational, tactical, and technical ownership of AWS data services, batch and real-time data pipeline architecture, Amazon EMR, AWS Glue, Glue Catalog, Kinesis data streams, data layer creation on Redshift, Aurora, and DynamoDB, and database migration utilizing AWS DMS. Bringing 6+ years of progressive professional experience in data engineering and cloud platforms, you will empower an elite multinational technology enterprise to achieve uncompromised data integration performance, scalable data warehousing, and superior analytics reliability. This prestigious career opportunity offers competitive remuneration, international enterprise client exposure, and professional growth within a leading global technology and consulting corporation.

Detailed Job Description

As a Data Engineer specializing in Data Platforms on AWS supporting IBM on a professional basis across Pune, Bangalore, and Chennai, you will take full operational, tactical, and technical ownership of advisory services, data pipeline development, and cross-functional engineering collaboration. Your day-to-day responsibilities include advising on, developing, and maintaining sophisticated data engineering solutions across the AWS Cloud ecosystem, designing, building, and operating batch and real-time data pipelines utilizing core AWS services such as Amazon EMR, AWS Glue, Glue Catalog, and Amazon Kinesis, ensuring seamless integration and high-performance operation of enterprise data engineering solutions, creating robust data layers utilizing Amazon Redshift, Amazon Aurora, and Amazon DynamoDB, migrating legacy data efficiently using AWS Database Migration Service (DMS), collaborating proactively with software engineering squads, data scientists, and business stakeholders, and interacting directly with talent acquisition teams like Nidhi Kumari at IBM. Furthermore, you will manage application requirements by submitting your updated CV via direct email to [e-mail].

Key Responsibilities

• Advise on, architect, develop, and maintain advanced data engineering solutions within the AWS Cloud ecosystem.
• Design, build, test, and operate high-throughput batch and real-time data processing pipelines utilizing AWS services.
• Implement and manage data ingestion and streaming architectures leveraging Amazon Kinesis and AWS Glue.
• Configure and optimize managed big data environments utilizing Amazon EMR and AWS Glue Catalog.
• Create scalable, secure analytical data layers utilizing Amazon Redshift, Amazon Aurora, and Amazon DynamoDB.
• Execute seamless database migrations and schema conversions utilizing AWS Database Migration Service (DMS).
• Collaborate proactively with data science, software engineering, and database administration teams to streamline data workflows.
• Ensure strict adherence to enterprise data governance, security compliance, and performance optimization standards.
• Maintain meticulous data architecture documentation, pipeline configuration backups, and operational runbooks.

Required Qualifications & Skills

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Engineering, or a related technical discipline.
• Minimum of 6+ years of progressive professional hands-on experience in data engineering, cloud platforms, and ETL pipeline development.
• Strong, demonstrable operational expertise in designing and developing data pipelines utilizing AWS services (Amazon EMR, AWS Glue, Glue Catalog, Kinesis).
• Comprehensive working knowledge and practical proficiency in creating analytical data layers on Amazon Redshift, Aurora, and DynamoDB.
• Deep practical experience executing database migrations utilizing AWS Database Migration Service (DMS).
• Solid practical grasp of distributed data processing, SQL optimization, and Python or Scala programming.
• Strong analytical problem-solving aptitude and effective stakeholder communication capabilities.
• Mandatory legal work authorization and physical availability for professional operations across Pune, Bangalore, or Chennai locations.

Nice-to-Have Skills

• Professional AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect – Professional.
• Prior professional working experience supporting Tier-1 global financial institutions, enterprise SaaS companies, or large IT consultancies.
• Hands-on familiarity with modern data lakehouse architectures (Apache Iceberg, Delta Lake) and containerized orchestration (Docker, Kubernetes).
• Experience utilizing enterprise agile tracking and IT service desk platforms (Jira, Confluence, ServiceNow).
• Active participation in AWS user groups, data engineering forums, or cloud computing associations.

Application Information

• Salary/Rate: Market Competitive / Enterprise Cloud Data Engineering Package
• Work Schedule: Professional Operations (Pune, Bangalore, Chennai)
• Deadline: Open until filled (Urgent India AWS Data Engineer Opening)
• Notice Period: Immediate to 30 Days Preferred
• Contract Duration: Permanent / Full-Time Employment

Recruitment Pro Tip

When applying for this Data Engineer – Data Platforms – AWS position with IBM across Pune, Bangalore, or Chennai, ensure your resume explicitly highlights your Amazon EMR/Glue pipeline tenure, Redshift/Aurora data layer design experience, and AWS DMS migration background.