AWS Python Pyspark Apache Databrics

Tata Consultancy Services; Pune District, Chennai District, Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Tata Consultancy Services in Pune/Bangalore/Hyderabad invites an experienced Data Engineer to join our AWS-based data platform. You will design and optimize data pipelines using Python, PySpark, and Databricks, delivering scalable ETL/ELT workflows on AWS.

The ideal candidate has 8–12 years of experience, 15 years of full-time education, and a strong foundation in SQL, data quality, and governance. You will collaborate with architects and analysts to define data models and ensure reliable,

Qualifications

• 8–12 years of data engineering experience.
• Strong SQL, Python, and PySpark skills.
• Experience with Databricks and AWS data services.

Responsibilities

• Design, develop, and maintain data ingestion, transformation, and integration pipelines using Python, PySpark, and SQL.
• Build scalable ETL/ELT workflows across AWS data ecosystems.
• Implement data quality, performance optimization, and pipeline automation.

Skills

SQL

Python

PySpark

Databricks

AWS

Education

15 years of full-time education

Tools

Databricks

AWS

Glue

Redshift

S3

Lambda

EMR

Job description

Greetings,

TCS is looking for AWS Python Pyspark Apache Databrics

Experience: 8 TO 12 Years

Education: Minimum 15 years of fulltime education (10th, 12th and Graduation)

Location - Pune , Bangalore, Hyderabad,Pune

• Experienced Data Engineer with strong expertise in SQL, Python, and PySpark with databricks , capable of building and optimizing modern data pipelines on AWS cloud platforms.

• The ideal candidate will have a strong foundation in data engineering principles, and experience with Databricks

• Design, develop, and maintain data ingestion, transformation, and integration pipelines using Python, PySpark, and SQL.
• Build scalable ETL/ELT workflows for structured and unstructured data across AWS data ecosystems.
• Implement best practices in data quality, performance optimization, and pipeline automation.
• Collaborate with architects and analysts to define data models, schemas, and integration frameworks.
• Work with cloud-native services such as:
• AWS: Glue, Redshift, S3, Lambda, EMR,Databricks
• Develop reusable components and frameworks for pipeline orchestration and monitoring.
• Troubleshoot data issues and ensure data reliability, security, and governance.

Thanks & Regards

Talent Acquisition Group.

Tata Consultancy Services.