AWS Data Engineer

Objectways; Bengaluru; On-site; INR 1,500,000 - 2,200,000; Full time

Job summary

Objectways is looking for a Data Engineer in Bengaluru, India, to design and optimize scalable data pipelines on AWS. The ideal candidate will have 5+ years of experience in data engineering, with strong skills in ETL development and AWS tools, including Glue and Kinesis.

Responsibilities include building data pipelines under the Medallion Architecture, ensuring data quality and governance, and collaborating with stakeholders to meet data requirements. Preferred qualifications include AWS certifications and experience with Agile methodologies.

Qualifications

• 5+ years of experience in Data Engineering.
• Experience building enterprise-scale ETL/ELT and Lakehouse solutions.
• Strong understanding of data modeling and data quality practices.

Responsibilities

• Design and maintain AWS-based data pipelines.
• Build ETL/ELT workflows using AWS Glue and Python.
• Integrate data solutions with AWS tools and ensure data quality.

Skills

Data pipeline design

ETL/ELT development

AWS Glue

Python

SQL

Data modeling

Apache Spark/PySpark

Kinesis

Data governance

Tools

AWS Redshift

AWS DMS

AWS Athena

Apache Iceberg

AWS Lake Formation

Job description

We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines and lakehouse solutions on AWS. The ideal candidate will have strong experience in enterprise-scale data engineering, ETL development, and modern cloud-based data platforms. This role will be responsible for building and maintaining Medallion Architecture (Bronze, Silver, Gold) data pipelines to support analytics, reporting, and business intelligence initiatives.

Key Responsibilities

• Design, develop, and maintain AWS-based data pipelines following Medallion Architecture (Bronze, Silver, Gold).
• Build and optimize ETL/ELT workflows using AWS Glue, Spark, and Python.
• Develop and manage data ingestion pipelines using AWS DMS and Kinesis.
• Implement data transformation and enrichment processes to support analytics and reporting requirements.
• Integrate data solutions with AWS Athena, Redshift, and other downstream data consumers.
• Create and maintain datasets using Parquet and Apache Iceberg formats.
• Ensure data quality, consistency, governance, and lineage across the data platform.
• Implement monitoring, logging, and alerting mechanisms to maintain pipeline reliability.
• Collaborate with Data Architects, Data Analysts, and Business Stakeholders to understand data requirements and deliver scalable solutions.
• Participate in CI/CD implementation and automation for ETL deployment and maintenance.
• Support data cataloging, governance, and security initiatives using AWS Lake Formation and/or DataZone.

Required Qualifications

• 5+ years of experience in Data Engineering.
• Proven experience building enterprise-scale ETL/ELT and Lakehouse solutions.
• Experience handling large-scale data processing and analytics workloads.
• Strong understanding of data modeling, performance optimization, and data quality practices.
• Strong hands‑on experience with AWS Glue, AWS DMS (Database Migration Service), AWS Kinesis, Amazon Athena, Amazon Redshift, Apache Spark / PySpark, Python, SQL.
• Experience working with Parquet, Apache Iceberg, Data Lake and Lakehouse architectures.
• Knowledge of Git version control and CI/CD pipelines for data engineering workflows.
• Experience with data governance, metadata management, and cataloging tools such as AWS Lake Formation and AWS DataZone.

Preferred Qualifications

• AWS Certified Data Analytics – Specialty.
• AWS Certified Solutions Architect.
• Experience with modern data platform modernization initiatives.
• Exposure to Agile/Scrum development methodologies.