Aws Data Engineer

Lancesoft; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Lancesoft is seeking an AWS Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure on the AWS cloud. You will work with data scientists, analysts, and stakeholders to implement ETL/ELT processes and ensure data governance and security.

The role emphasizes building data lakes and data warehouses using S3, Redshift and Athena, plus optimizing pipelines for performance and cost efficiency.

Qualifications

• Experience designing and implementing scalable data pipelines on AWS.
• Strong ETL/ELT process expertise and data modeling knowledge.
• Experience with Spark/Hadoop is a plus.
• Ability to collaborate with data scientists and stakeholders.

Responsibilities

• Design and develop data pipelines using AWS services such as Glue, Lambda and Step Functions.
• Build and manage data lakes and data warehouses on S3, Redshift, and Athena.
• Execute ETL/ELT to ingest, transform and load data from multiple sources.
• Optimize data workflows for performance, scalability and cost efficiency.
• Ensure data quality, governance and security compliance.
• Collaborate with data scientists, analysts and stakeholders.
• Monitor and troubleshoot pipeline issues.

Skills

Data pipelines design

ETL/ELT

Cloud architecture

Data quality governance

Tools

Amazon S3

AWS Glue

Amazon Redshift

AWS Lambda

Amazon Kinesis

AWS IAM

CloudWatch

Python

SQL

Apache Spark

Hadoop

ETL frameworks

Data modeling

Job description

Role & responsibilities

AWS Data Engineer Job Description

Role Overview

We are looking for an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure on AWS cloud. The ideal candidate will have strong experience in big data technologies, ETL processes, and cloud-based data platforms.

Key Responsibilities

• Design and develop data pipelines using AWS services like Glue, Lambda, and Step Functions
• Build and manage data lakes and data warehouses using Amazon S3, Redshift, and Athena
• Perform ETL/ELT processes to ingest, transform, and load data from multiple sources
• Optimize data workflows for performance, scalability, and cost efficiency
• Ensure data quality, governance, and security compliance
• Collaborate with data scientists, analysts, and stakeholders
• Monitor and troubleshoot pipeline issues

Required Skills

Core AWS Services

• Amazon S3
• AWS Glue
• Amazon Redshift
• AWS Lambda
• Amazon Kinesis (for streaming)
• AWS IAM (security)
• CloudWatch (monitoring)

Programming & Tools

• Python / PySpark / Scala
• SQL (advanced querying)
• Apache Spark / Hadoop (optional but valuable)
• ETL tools and frameworks
• Data modeling (star/snowflake schema)

Preferred candidate profile