Azure Data Engineer

SP Staffing; Pune District, Mumbai, Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

SP Staffing is seeking a senior data engineer with 6–12 years of experience for roles based in Pune/Mumbai/Chennai.

You will design and optimize data pipelines using PySpark, Databricks notebooks, and Azure Data Factory, handling diverse data sources and SQL-based processing.

Qualifications

• Experience in Spark-based data engineering and cloud data platforms.
• Proficient in building data pipelines using Azure Data Factory.
• Strong SQL skills and Python programming for data processing.

Responsibilities

• Develop and maintain data pipelines using PySpark and Databricks notebooks.
• Integrate, transform, and consolidate data from structured and unstructured sources.
• Implement and optimize dashboards and data models using Azure services.

Skills

Pyspark

Azure Databricks

SQL

Python

Azure Data Factory

ADLS

Storage Services

Serverless architecture

Azure Functions

Data pipelines (ADF)

Tools

SQL tooling

Job description

Experience:6-12yrs

Work Location : Pune/Mumbai/Chennai

Job Description:

• Experience in Pyspark and Azure Databricks.
• Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.
• Good experience in SQL or native SQL query languages.
• Strong experience in implementing Databricks notebooks using Python.
• Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions.
• Advanced working knowledge in building robust data pipelines using ADF