Data Engineer

Tata Consultancy Services Limited; Chennai District; Presencial; INR 2.500.000 - 4.000.000; Jornada completa

Descripción de la vacante

Tata Consultancy Services Limited in Chennai is seeking an experienced AWS Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data engineering solutions using Python, PySpark and AWS data services.

The role demands strong SQL and data warehousing knowledge, data lake/warehouse implementations, ETL/ELT expertise, and performance tuning of Spark applications within an Agile framework.

Formación

• 6+ years of experience in data engineering.
• Hands-on experience designing scalable data pipelines on AWS.
• Proficient in Python, PySpark and AWS data services.
• Strong SQL and data warehousing concepts.
• Experience with ETL/ELT frameworks; data lake/warehouse implementations.

Responsabilidades

• Design, develop, and optimize scalable data pipelines and cloud-based data engineering solutions.
• Build and maintain ETL/ELT processes on AWS.
• Develop and implement data lake and data warehouse architectures.
• Tune and optimize Spark applications for performance.
• Collaborate in Agile development environments.

Conocimientos

Python

PySpark

AWS

SQL

Data Warehousing

ETL/ELT

Data Lake

Herramientas

S3

EMR

Glue

Lambda

IAM

Redshift

Descripción del empleo

Greetings from Tata Consultancy Services (TCS)!

We are currently hiring experienced Data Engineers.

Experience Required: 6+ Years

We are looking for an experienced AWS Data Engineer with strong expertise in Python, PySpark, and AWS Data Services to design, develop, and optimize scalable data pipelines and cloud-based data engineering solutions. The ideal candidate should have hands-on experience in developing large-scale data processing applications, data lake implementations, and ETL/ELT frameworks on AWS

Must-Have Skills:

• Strong programming experience in Python
• Hands-on expertise in PySpark

Experience with AWS services such as:

• S3
• EMR
• Glue
• Lambda
• IAM
• Redshift

Strong SQL and Data Warehousing concepts

Experience in building ETL/ELT pipelines

Data Lake/Data Warehouse implementation experience

Performance tuning and optimization of Spark applications

Understanding of Agile development methodologies