AWS Databricks with Python Walk In Drive at Noida

Tata Consultancy Services; Dadri; On-site; INR 1,500,000 - 3,200,000; Full time

Job summary

Tata Consultancy Services in Noida is seeking an experienced AWS Data Engineer (Databricks) with Python to design, develop, and maintain scalable ETL/ELT data pipelines using Spark on Databricks and to integrate with AWS services such as S3, Glue, Lambda, and Redshift.

You will contribute to data lake and warehouse architecture, orchestrate workflows with Databricks Workflows or Airflow, optimize performance, troubleshoot issues, and collaborate with stakeholders to ensure data governance and

Qualifications

• Proven experience in data engineering with Databricks and AWS data services.
• Strong Python/SQL skills and knowledge of Apache Spark.
• Solid grounding in data warehousing, ETL/ELT, and data modeling.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines in Databricks with Spark.
• Integrate Databricks with AWS services (S3, Glue, Lambda, Redshift).
• Contribute to data lake/warehouse architecture and modeling.

Skills

Python

SQL

Apache Spark

ETL/ELT

Data Modeling

Communication

Education

Bachelor's degree in a relevant field

Tools

Databricks

AWS data services (S3/Glue/Lambda/Redshift)

Airflow

Git

Job description

TCS has been a great pioneer in feeding the fire of Young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.

TCS is Hiring for AWS Databricks with Python

Experience Range: - 4 To 7

Job Locations : Noida

AWS Data Engg (Databricks):

Exp: 4-7 yrs

Key responsibilities for this role include designing, developing, and maintaining ETL/ELT data pipelines in Databricks using Spark, and integrating Databricks with various AWS services like S3, Glue, Lambda, and Redshift. They contribute to data lake and data warehouse architecture and modeling, orchestrate workflows with tools like Databricks Workflows or Airflow, and optimize performance and troubleshoot issues. Collaboration with stakeholders to define data requirements, implement quality checks, and ensure data governance is also crucial.

Required Skills & Qualifications

Required skills include proven experience in data engineering with Databricks and AWS data services, proficiency in Python or Scala and advanced SQL, and expertise in Apache Spark. In-depth knowledge of core AWS data services and a solid understanding of data warehousing principles, ETL/ELT, and data modeling are essential. Familiarity with DevOps, Git, and orchestration tools is also needed. A bachelor's degree is typical, and relevant certifications like AWS Certified Data Engineer or Databricks Certified Data Engineer are beneficial.