AWS Data Engineer

Tata Consultancy Services; Chennai District; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Tata Consultancy Services is seeking an experienced AWS Data Engineer in Chennai to design and optimize scalable data pipelines on AWS. You will use Python and PySpark to develop ETL/ELT workflows, build data lakes and warehousing solutions, and ensure data quality and performance.

The ideal candidate has 5–15 years of IT experience, strong AWS skills, and a solid grasp of data architecture. Chennai location with on-site work at the Siruseri campus may apply.

Qualifications

• Strong programming experience in Python and PySpark
• Hands-on with AWS services (S3, EMR, Glue, Lambda, IAM, Redshift) and data warehousing concepts
• Experience building ETL/ELT pipelines and data lake/warehouse implementations

Responsibilities

• Design, develop and optimize scalable data pipelines on AWS
• Build and maintain batch and real-time data processing solutions
• Collaborate with stakeholders to gather requirements and deliver data solutions
• Perform data quality checks and monitor pipeline performance

Skills

Python

PySpark

AWS Services

SQL

Data Warehousing

ETL/ELT

Data Lake

Spark Tuning

Agile

Education

BE / B.Tech / MCA / M.Tech or equivalent

Tools

Databricks

dbt

Snowflake

Terraform

Kafka

Job description

Registration Time: 9:00 AM to 12:30 PM

Experience: 5 to 15 years

#Chennai Tata Consultancy Services : Siruseri Campus is located at Plot No. 1/G1, SIPCOT IT Park, Navalur Post, Siruseri, Chennai, Tamil Nadu 603103

Experience:

6 – 12 Years

Location:

Job Description:

We are looking for an experienced AWS Data Engineer with strong expertise in Python, PySpark, and AWS Data Services to design, develop, and optimize scalable data pipelines and cloud-based data engineering solutions. The ideal candidate should have hands‑on experience in developing large-scale data processing applications, data lake implementations, and ETL/ELT frameworks on AWS. [TCS_JD_Tem...Developer | Word], [TCS_JD_Tem...pr aws TRP | Word]

Must-Have Skills:

• Strong programming experience in Python
• Hands‑on expertise in PySpark
• Experience with AWS services such as:
• S3
• EMR
• Glue
• Lambda
• IAM
• Redshift
• Strong SQL and Data Warehousing concepts
• Experience in building ETL/ELT pipelines
• Data Lake/Data Warehouse implementation experience
• Performance tuning and optimization of Spark applications
• Understanding of Agile development methodologies

Good-to-Have Skills:

• Databricks
• dbtSnowflake
• Terraform
• Kafka
• Design, develop, and maintain scalable data pipelines using Python and PySpark.
• Build and optimize ETL/ELT processes on AWS cloud platforms.
• Develop batch and real-time data processing solutions.
• Work with large-scale structured and unstructured datasets.
• Create and maintain Data Lakes and Data Warehouse solutions.
• Perform data quality validation, monitoring, and troubleshooting.
• Collaborate with business stakeholders, architects, and development teams to gather requirements and deliver data solutions.
• Optimize Spark jobs for performance, scalability, and cost efficiency.Participate in code reviews and ensure adherence to coding standards.
• Support production deployments and resolve critical incidents.
• 6–12 years of overall IT experience.
• Minimum 4+ years of hands‑on experience in Python and PySpark development.
• Experience in AWS-based data engineering projects.
• Strong exposure to Data Warehousing and Data Lake architectures. [TCS_JD_Tem...Databricks | Word], [TCS_JD_Tem...Developer | Word]

Education:

• BE / B.Tech / MCA / M.Tech or equivalent.