Lead cloud Data Engineer

Tata Consultancy Services; Dubai; On-site; AED 180,000 - 300,000; Full time

Job summary

Tata Consultancy Services in Dubai is seeking a Senior Data Engineer to design and implement cloud data pipelines using Databricks and Azure Data Factory. The role requires strong PySpark skills and experience in enterprise data warehousing in a multi-cloud, on-premise hybrid environment.

You will work within Agile teams to translate business requirements into scalable data engineering workloads, ensuring robust data lake architectures and operational reliability in a fast-moving IT services

Qualifications

• 3+ years of experience building Databricks and Azure Data Factory pipelines.
• Strong hands-on data engineering in cloud environments, with medallion architecture awareness.
• Experience with PySpark and Spark distributed computing.
• Experience in enterprise data warehouse workloads and cloud deployment — Azure preferred.

Responsibilities

• Understand data ingestion requirements from business lines and translate to data engineering workloads.
• Develop Databricks and Azure Data Factory pipelines to meet requirements.
• Apply medallion architecture in Azure Data Lake to organize data zones.
• Collaborate in multi-disciplinary Agile teams to deliver solutions.
• Scale applications in multi-cloud environments integrated with on-premise systems.

Skills

Azure Data Factory

Databricks

PySpark

Cloud data engineering

Agile teams

Education

Bachelor's degree in Computer Science/Information Technology or Engineering

Tools

Azure

Spark

Job description

Tata Consultancy Services (TCS) is an IT services, consulting and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 50 years. TCS offers a consulting-led, cognitive powered, integrated portfolio of business, technology and engineering services and solutions. This is delivered through its unique Location Independent Agile™ delivery model, recognized as a benchmark of excellence in software development.

A part of the Tata group, India's largest multinational business group, TCS has over 616,171 of the world’s best-trained consultants with 157 nationalities in 53 countries. For more information, visit www.tcs.com and follow TCS news at @TCS_News.

Key Responsibilities

Job Context

• Work with the business lines to understand the data ingestion and cloud data engineering requirements
• Work with the data modellers to translate the same into cloud/on-prem data engineering workloads design and then develop the same into appropriate engineering language – Databricks pipelines and ADF pipelines.
• Very strong hands-on skills and at least 3 years experience in developing databricks and Azure Data Factory pipelines
• Follow the principle of medallion architecture (3 layers of data in Azure data lake) of getting the data in right data zones basis the requirement
• Work and collaborate in multi-disciplinary Agile teams, adopting Agile spirit, methodology and tools
• Help code and scale applications in a multi-cloud environment integrated with on-premise
• Work with the platform lead to spot out and remediate the potential operational risks of the platform

Qualifications & Experience

• Years of experience in data engineering and transformation on Cloud
• Years of Very Strong Experience in Azure Data Engineering, Databricks
• Expertise in supporting/developing Data warehouse workloads at enterprise level
• Experience in pyspark is required – developing and deploying the workloads to run on the Spark distributed computing
• Candidate must possess at least a Graduate or bachelor’s degree in Computer Science/Information Technology, Engineering (Computer/Telecommunication) or equivalent.
• Cloud deployment: Preferably Microsoft azure
• Experience in implementing the platform and application monitoring using Cloud native tools
• Experience in implement application self-healing solutions through proactive and reactive automated measures

Application Deadline: 30th -September-2026

Privacy Note:

https://www.tcs.com/connect-with-tcs/privacy-policy