Azure Data Engineer | Walkin Interview

SP Staffing; Pune District; In loco; INR 900.000 - 1.300.000; Tempo pieno

Descrizione del lavoro

SP Staffing is seeking a data engineering professional for a Pune-based role focusing on big data pipelines and cloud data platforms.

The candidate will work on PySpark with Azure Databricks, implement data ingestion and transformations, and build Databricks notebooks in Python for robust data processing pipelines.

Competenze

• Experience in PySpark and Azure Databricks.
• Proficiency in integrating, transforming, and consolidating data from various sources.
• Good experience in SQL and native SQL query languages.
• Strong experience in Databricks notebooks using Python.
• Experience with Azure Data Factory, ADLS, Storage Services and serverless components.

Mansioni

• Design and implement robust data pipelines using PySpark and Databricks.
• Develop and optimize data integration from structured and unstructured sources.
• Build notebooks in Databricks using Python to process data.
• Leverage Azure Data Factory and ADLS for data movement and storage.

Conoscenze

PySpark

Azure Databricks

Python

SQL

Data pipelines

Strumenti

Azure Data Factory

Azure Data Lake Storage

Azure Functions

Serverless architecture

Descrizione del lavoro

Warm Greetings from SP Staffing Services Pvt Ltd!!!!

Experience:6-11yrs

Work Location : Pune

Job Description:

• Experience in Pyspark and Azure Databricks.
• Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources.
• Good experience in SQL or native SQL query languages.
• Strong experience in implementing Databricks notebooks using Python.
• Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions.
• Advanced working knowledge in building robust data pipelines using ADF