Databricks - Senior Engineer

Iris Software; Dadri; On-site; INR 9,00,000 - 12,00,000; Full time

Job summary

A leading software company is seeking an experienced data professional with advanced skills in Databricks and PySpark. The ideal candidate must have a solid understanding of SQL, including optimization techniques, and be familiar with Azure tools such as Data Factory and Data Lake. Proficiency in Python is also required to excel in this data-driven role located in Dadri, Uttar Pradesh, India. Candidates should have a passion for big data, machine learning, and cloud technologies.

Skills

Databricks

SQL

PySpark

Azure Delta Lake

Python

Job description

Core skills required for the role :

1. Databricks Level: Advanced
2. SQL (MSSQL Server) Joins, SQ optimization, basic knowledge of StoredProcedure, Functions
3. PySpark Level: Advanced
4. Azure Delta lake
5. Python Basic

Mandatory Competencies

• Big Data - Big Data - Pyspark
• Data Science and Machine Learning - Data Science and Machine Learning - Databricks
• Cloud - Azure - Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Storage, Event Hubs, HDInsight
• Database - Sql Server - DBA
• Data Science and Machine Learning - Data Science and Machine Learning - Python