Aws Data Engineer

Lancesoft; Bengaluru; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Lancesoft is seeking an experienced AWS Data Engineer responsible for designing, building, and maintaining scalable data pipelines and infrastructure on the AWS cloud. The ideal candidate should have a robust background in big data technologies and ETL processes.

Your key responsibilities include developing data pipelines using AWS services like Glue and Lambda, managing data lakes with Amazon S3 and Redshift, and ensuring data quality and governance. Strong programming skills in Python and SQL are also essential for success in this role.

Qualifications

• Strong experience in big data technologies and ETL processes.
• Experience with AWS cloud-based data platforms is essential.
• Ability to design and optimize scalable data pipelines.

Responsibilities

• Design and develop data pipelines using AWS services.
• Build and manage data lakes and data warehouses using Amazon S3.
• Perform ETL/ELT processes to ingest and transform data.

Skills

Amazon S3

AWS Glue

Amazon Redshift

AWS Lambda

Python

SQL

PySpark

Scala

Job description

Role & responsibilities

AWS Data Engineer Job Description

Role Overview

We are looking for an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure on AWS cloud. The ideal candidate will have strong experience in big data technologies, ETL processes, and cloud-based data platforms.

Key Responsibilities

• Design and develop data pipelines using AWS services like Glue, Lambda, and Step Functions
• Build and manage data lakes and data warehouses using Amazon S3, Redshift, and Athena
• Perform ETL/ELT processes to ingest, transform, and load data from multiple sources
• Optimize data workflows for performance, scalability, and cost efficiency
• Ensure data quality, governance, and security compliance
• Collaborate with data scientists, analysts, and stakeholders
• Monitor and troubleshoot pipeline issues

Required Skills

Core AWS Services

• Amazon S3
• AWS Glue
• Amazon Redshift
• AWS Lambda
• Amazon Kinesis (for streaming)
• AWS IAM (security)
• CloudWatch (monitoring)

Programming & Tools

• Python / PySpark / Scala
• SQL (advanced querying)
• Apache Spark / Hadoop (optional but valuable)
• ETL tools and frameworks
• Data modeling (star/snowflake schema)

Preferred candidate profile