Azure Data Engineer with ADB, Pyspark

Tata Consultancy Services; Pune District; Vor Ort; INR 1.500.000 - 2.300.000; Vollzeit

Zusammenfassung

Tata Consultancy Services (TCS) in Pune is seeking an experienced Azure Data Engineer with expertise in ADB and PySpark to design and optimize modern data pipelines. The ideal candidate will have 6–10 years of experience, knowledge of SQL, Python, Databricks, and AWS components, and will build scalable ETL/ELT workflows while ensuring data quality and governance.

You will collaborate with architects and analysts on cloud-native projects across the AWS data ecosystem and contribute to data

Qualifikationen

• Strong SQL, Python, PySpark with Databricks; build and optimize data pipelines on AWS.
• Solid data engineering foundation; experience with Databricks.
• Design, develop, and maintain data ingestion, transformation, and integration pipelines.
• Build scalable ETL/ELT workflows for structured and unstructured data on AWS.
• Apply data quality, performance optimization, and automation best practices.
• Collaborate with architects to define data models and integration frameworks.
• Familiar with cloud services AWS Glue, Redshift, S3, Lambda, EMR; Databricks.
• Develop reusable components for orchestration and monitoring.
• Troubleshoot data issues; ensure data reliability, security, and governance.

Kenntnisse

SQL

Python

PySpark

Databricks

Ausbildung

15 years of full-time education (10+12+Graduation)

Tools

Databricks

AWS

Glue

Redshift

S3

Lambda

EMR

Jobbeschreibung

Greetings,

TCS is looking for Azure Data Engineer with ADB, Pyspark

Experience: 6 TO 10 Years

Education: Minimum 15 years of fulltime education (10th, 12th and Graduation)

Location - Pune

Notice Period- 90 Days only

• Experienced Data Engineer with strong expertise in SQL, Python, and PySpark with databricks , capable of building and optimizing modern data pipelines on AWS cloud platforms.
• The ideal candidate will have a strong foundation in data engineering principles, and experience with Databricks
• Design, develop, and maintain data ingestion, transformation, and integration pipelines using Python, PySpark, and SQL.
• Build scalable ETL/ELT workflows for structured and unstructured data across AWS data ecosystems.
• Implement best practices in data quality, performance optimization, and pipeline automation.
• Collaborate with architects and analysts to define data models, schemas, and integration frameworks.
• Work with cloud-native services such as:
• AWS: Glue, Redshift, S3, Lambda, EMR,Databricks
• Develop reusable components and frameworks for pipeline orchestration and monitoring.
• Troubleshoot data issues and ensure data reliability, security, and governance.

Thanks & Regards

Talent Acquisition Group.

Tata Consultancy Services.