Tcs CHN Walk-In-Drive Azure Data Engineer (5 To 10yrs)

Tata Consultancy Services Limited; Chennai; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Tata Consultancy Services Limited in Chennai is seeking a skilled data engineering specialist focused on Databricks and cloud-native data orchestration. The role emphasizes automation, CI/CD pipelines, and infrastructure as code to design and deploy robust data processing workflows.

Collaboration with data product owners and engineers is key to delivering scalable pipelines. The position involves evaluating new tools, onboarding solutions, and configuring services to maximize performance, with a

Qualifications

• Experience in automation and CI/CD pipelines.
• Familiarity with infrastructure as code (IaC) practices.
• Experience deploying data processing pipelines.

Responsibilities

• Managing and deploying linked services, datasets, and pipelines.
• Collaborates with Data Product Owners and Data Engineers to define data processing pipelines and schedules.
• Evaluates and does POC of any new tools/services.
• Enables and onboards new tools/services.
• Configures tools/services for optimum performance.
• Establishes integration patterns for various tools/services.

Skills

Databricks

Big data

Python/Scala

PySpark

Workflow orchestration

AWS

Snowflake

CI/CD

IaC

Tools

Databricks

Snowflake

AWS

CI/CD

IaC

Job description

Role & responsibilities

• Databricks Expertise, Big Data Processing, Python/Scala, Pyspark, Workflow Orchestration, AWS Cloud Integration, Databricks , Snowflake, AWS
• JD:
• Focuses on automation, CI/CD pipelines, and infrastructure as code.
• Managing and deploying linked services, datasets, and pipelines.
• Collaborates with Data Product Owners and Data Engineers to define data processing pipelines & schedules.
• Evaluates and does POC of any new tools/services.
• Enables and onboards new tools/services.
• Configures Tools/Services for optimum performance.
• Establishes Integration patterns for various tools/services.