Databricks Engineer

Zoho; Pune District; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Zoho in Pune district seeks a Lead/Senior Databricks Engineer with 8+ years of experience to design, build, and optimize scalable data pipelines on Databricks and Azure. You will shape modern data platforms and collaborate with stakeholders across analytics and engineering teams.

The role emphasizes strong SQL, PySpark, and data governance, with opportunities to implement Delta Lake and lakehouse architectures, CI/CD, and cloud-native data solutions.

Qualifications

• 8+ years of experience in data engineering and Databricks.
• Strong experience with Databricks, PySpark, Spark SQL, and Azure.
• Experience with ETL/ELT development and scalable data pipelines.
• Experience with SQL Server, SSIS, Data Warehouse, stored procedures, views and triggers.
• Knowledge of Azure Data Lake Storage Gen2.
• Familiarity with CI/CD and DevOps practices.
• Understanding of data governance, data quality, and medallion architecture.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using Databricks and PySpark.
• Build and optimize data ingestion frameworks from multiple data sources.
• Work with ADLS Gen2 for storage and processing.
• Implement Delta Lake and Lakehouse architecture concepts.
• Optimize Spark jobs for performance and scalability.
• Develop data transformations using SQL and PySpark.
• Collaborate with data architects, analysts, and business stakeholders.
• Implement CI/CD pipelines and deployment automation.
• Ensure data quality, security, and governance standards.

Skills

Databricks

PySpark

Spark SQL

SQL Server

Azure

ETL development

Data modeling

Git & CI/CD

Performance tuning

Data governance

Education

Bachelor's degree in CS/IT

Azure or Databricks certifications preferred

Tools

Delta Lake

ADLS Gen2

Lakehouse architecture

Job description

JobDescription - Lead/Senior Databricks Engineer

Experience: 8+ Years

Employment Type: Full-Time

Role Summary

We are lookingfor a skilled Data Engineer with strong experience in Databricks and Azure Cloud to design, develop, and optimize scalable data pipelinesand modern data platforms. The ideal candidate should have expertise in bigdata technologies, ETL development, and cloud-based data engineering.

KeyResponsibilities

• Design and develop scalable ETL/ELT pipelines using Databricks and PySpark.
  
• Build and optimize data ingestion frameworks frommultiple data sources.
  
• Work with Azure Data Lake Storage (ADLS Gen2) for storing and processing large datasets.
  
• Implement Delta Lake and Lakehousearchitecture concepts.
  
• Optimize Spark jobs for performance and scalability.
  
• Develop data transformations using SQL and PySpark.
  
• Collaborate with data architects, analysts, andbusiness stakeholders.
  
• Implement CI/CD pipelines and deployment automation.
  
• Ensure data quality, security, and governancestandards.
  

RequiredSkills

• Strong hands-on experience with Databricks
  
• Proficiency in PySpark and Spark SQL
  
• SSIS, Essbase, SQL Server, Data Warehouse, StoredProcedure, Views Triggers
  
• Experience with Microsoft Azure
  
• Good knowledge of:
  
• Strong SQL and data modeling skills
  
• Experience with Git and CI/CD processes
  
• Knowledge of performance tuning and optimization
  

PreferredSkills

• Experience with:
  
• Streaming using Spark StructuredStreaming
  
• Kafka/Event Hub
  
• Data Warehousing concepts
  
• DevOps and Infrastructure as Code
  
• Knowledge of:
  
• Data Governance
  
• Data Quality frameworks
  
• Medallion Architecture (Bronze,Silver, Gold)
  

EducationalQualification

• Bachelor's degree in Computer Science, InformationTechnology, or related field.
  
• Relevant Azure or Databricks certifications arepreferred.
  

Nice to HaveCertifications

Requirements

RequiredSkills

• Strong hands-on experience with Databricks
  
• Proficiency in PySpark and Spark SQL
  
• SSIS, Essbase, SQL Server, Data Warehouse, StoredProcedure, Views Triggers
  
• Experience with Microsoft Azure
  
• Good knowledge of:
  
• Strong SQL and data modeling skills
  
• Experience with Git and CI/CD processes
  
• Knowledge of performance tuning and optimization