Data Engineer (Databricks)

OSI Digital; Hyderabad; On-site; INR 900,000 - 1,500,000; Full time

Job summary

OSI Digital is seeking a Data Engineer to build scalable data pipelines and analytics solutions using Azure Databricks, PySpark, SQL, and Power BI. The role focuses on designing modern Lakehouse architectures, transforming raw data into actionable insights, and delivering high-performance reporting.

The candidate will design end-to-end data pipelines, optimize Delta Lake tables, and develop ETL/ELT workflows for large-scale processing while collaborating with business analysts to meet technical

Qualifications

• 3–6 years of experience in Data Engineering.
• Strong Python, PySpark, and Spark SQL.
• Hands-on experience with Azure Databricks, Delta Lake, Unity Catalog, and Delta Live Tables.
• Experience with Azure Databricks Workflows and Lakehouse architecture.
• Strong SQL development and query optimization skills.
• Expertise in Power BI, DAX, and Power Query.
• Strong analytical, troubleshooting, and communication skills.

Responsibilities

• Design and develop end-to-end data pipelines using Azure Databricks and PySpark.
• Build and optimize Delta Lake tables using Medallion Architecture (Bronze, Silver, Gold).
• Develop scalable ETL/ELT workflows for large-scale data processing.
• Create interactive Power BI dashboards and reports using DAX and Power Query.
• Write and optimize SQL queries for data transformation and analytics.
• Collaborate with business analysts to translate business requirements into technical solutions.
• Ensure data quality, performance, and scalability across data platforms.
• Support deployment, monitoring, and troubleshooting of data engineering solutions.

Skills

Python

PySpark

Spark SQL

Power BI

DAX

Power Query

Azure Databricks

Delta Lake

Unity Catalog

Delta Live Tables

Tools

Azure Databricks

Delta Lake

Job description

Job Summary

OSI Digital is looking for a Data Engineer with strong expertise in Azure Databricks, PySpark, SQL, and Power BI to build scalable data pipelines and analytics solutions. The ideal candidate will design modern Lakehouse architectures, transform raw data into actionable insights, and develop high-performance reporting solutions.

Job Details

Job Title: Data Engineer

Experience: 3–6 Years (Mid-Level)

Job Location: Hyderabad, India

Responsibilities

• Design and develop end-to-end data pipelines using Azure Databricks and PySpark
• Build and optimize Delta Lake tables using Medallion Architecture (Bronze, Silver, Gold)
• Develop scalable ETL/ELT workflows for large-scale data processing
• Create interactive Power BI dashboards and reports using DAX and Power Query
• Write and optimize SQL queries for data transformation and analytics
• Collaborate with business analysts to translate business requirements into technical solutions
• Ensure data quality, performance, and scalability across data platforms
• Support deployment, monitoring, and troubleshooting of data engineering solutions

Required Skills

• 3–6 years of experience in Data Engineering
• Strong expertise in Python, PySpark, and Spark SQL
• Hands‑on experience with Azure Databricks, Delta Lake, Unity Catalog, and Delta Live Tables
• Experience with Azure Databricks Workflows and Lakehouse architecture
• Strong SQL development and query optimization skills
• Expertise in Power BI, DAX, and Power Query
• Strong analytical, troubleshooting, and communication skills

Good To Have

• Experience with Azure Data Factory, Azure Synapse Analytics, or Azure Data Lake
• Knowledge of CI/CD and DevOps practices for data platforms
• Microsoft Azure Data Engineering Certification
• Experience working in Agile/Scrum environments

We Are Not Looking For Someone Who

• Has never worked directly with business stakeholders
• Lacks hands‑on experience with Azure Databricks and PySpark
• Has limited exposure to Power BI and SQL‑based data analytics