Azure Data Engineer

Tata Consultancy Services; Kolkata; On-site; USD 6,816 - 11,360; Full time

Job summary

An established industry player is seeking a Big Data Engineer to join their dynamic team in Kolkata. This role requires a strong background in Pyspark and Azure Databricks, focusing on data integration and transformation. You'll be responsible for implementing Databricks notebooks and working with various Azure services to enhance data processing capabilities. If you're passionate about leveraging technology to drive data solutions and have the experience to back it up, this is the perfect opportunity for you to make a significant impact in the IT services sector.

Qualifications

• 3+ years of experience in Pyspark and Azure Databricks.
• Proficient in SQL and data integration from various sources.

Responsibilities

• Integrate, transform, and consolidate data from structured and unstructured sources.
• Implement Databricks notebooks using Python.

Skills

Pyspark

Azure Databricks

SQL

Python

Data integration

Data transformation

Tools

Azure Data Factory

ADLS

Storage Services

Serverless architecture

Azure functions

Job description

TCS is inviting candidates for a walk-in on 08th March 25 for the following role:

Position: Big Data Engineer

Experience: 4 to 10 years

Joining Location: Kolkata

Job Description

3+ years of relevant experience in Pyspark and Azure Databricks.

Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.

Good experience in SQL or native SQL query languages.

Strong experience in implementing Databricks notebooks using Python.

Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, and Azure functions.

Seniority Level

• Mid-Senior level

Employment Type

• Full-time

Job Function

• Information Technology
• Engineering
• Other

Industries

• IT Services and IT Consulting