Aws Data Engineer (6 locations)

Tata Consultancy Services; Chennai District, Bengaluru; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Tata Consultancy Services in India is seeking a skilled data engineering professional to lead data integration, ETL development, and analytics pipeline work across AWS services. The role requires hands-on experience with AWS Glue, Lambda, Athena, Redshift, PySpark, Spark, SQL, Python, and real-time workflows.

You'll work on building scalable data pipelines, leveraging AWS analytics services, and integrating various data sources using tools like Informatica Cloud, Talend, and Matillion.

Qualifications

• Professional experience in data integration and management.
• Hands on development experience in AWS Glue, Lambda functions, AWS Athena, Redshift, PySpark is a Must.
• Hands on working experience in AWS GLUE ETL tool and having good knowledge on any of the ETL tools(Informatica cloud, Talend etc.)
• Must have working experience with SQL, and databases (e.g.: Postgres, Redshift) implementing Data Models.
• Expertise with Python Language and Apache Spark. Have working experience in projects involving these.
• Strong hands on exposure to AWS Analytics services particularly Lambda, Step functions, Athena, Glue, Data-Pipelines
• Understanding and technical knowledge on AWS service like EC2, S3. Should have used these technologies in previously executed projects.
• Strong AWS development experience for data ETL/pipeline/integration/automation work. Should have a deep understanding of BI & Analytics Solution development lifecycle.
• Full Flexed in AWS cloud development & Automation for Analytics. Should have a deep understanding of AWS Services (Redshift, Glue, Lambda, Athena, S3, EC2), Visual Studio, SQL Server, SSIS, Matillion; Python
• Strong experience on real-time scalable workflow implementation.

Skills

Data integration

AWS Glue

AWS Lambda

AWS Athena

Amazon Redshift

PySpark

Apache Spark

AWS Step Functions

SQL

Python

AWS EC2

AWS S3

ETL development

Real-time data workflow

Tools

Informatica Cloud

Talend

Matillion

Visual Studio

SSIS

SQL Server

Job description

JOB LOCATION: Bengaluru, Chennai, Hyderabad, Pune, Kochi, Kolkata

Must Have Skills:

• Professional experience in data integration and management
• Hands on development experience in AWS Glue, Lambda functions, AWS Athena, Redshift, Pyspark is a Must
• Hands on working experience in AWS GLUE ETL tool and having good knowledge on any of the ETL tools(Informatica cloud, Talend etc.)
• Must have working experience with SQL, and databases (e.g.: Postgres, Redshift) implementing Data Models.
• Expertise with Python Language and Apache Spark. Have working experience in projects involving these.
• Strong hands on exposure to AWS Analytics services particularly Lambda, Step functions, Athena, Glue, Data-Pipelines
• Understanding and technical knowledge on AWS service like EC2, S3. Should have used these technologies in previously executed projects.
• Strong AWS development experience for data ETL/pipeline/integration/automation work. Should have a deep understanding of BI & Analytics Solution development lifecycle.
• Full Flexed in AWS cloud development & Automation for Analytics. Should have a deep understanding of AWS Services (Redshift, Glue, Lambda, Athena, S3, EC2), Visual Studio, SQL Server, SSIS, Matillion; Python
• Strong experience on real-time scalable workflow implementation.

Good to Have Skills:

• Excellent written and oral communication skills; Ability to communicate effectively with technical and non-technical staff.
• Experience working on multiple concurrent projects.
• Excellent problem-solving skills.