Data Engineer - Databricks

Onedatasoftware

Coimbatore District

On-site

INR 1,000,000 - 1,500,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A technology company is seeking an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions in Microsoft Azure. The ideal candidate will have strong hands-on experience with Azure Databricks, proficiency in Python, and knowledge of ETL/ELT pipeline development. Responsibilities include implementing Lakehouse architecture and collaborating with analytics teams. Joining this role offers the chance to work within a dynamic tech environment.

Qualifications

  • Strong hands-on experience with Azure Databricks (Notebooks, Workflows, Delta Tables).
  • Proficiency in Python, PySpark, and SQL.
  • Experience with Azure Data Factory (ADF) and ADLS.
  • Good understanding of Delta Lake and Medallion Architecture.
  • Knowledge of CI/CD and Git version control.

Responsibilities

  • Design and develop scalable ETL/ELT pipelines using Azure Databricks.
  • Implement Lakehouse architecture using Delta Lake.
  • Develop batch and streaming data pipelines using PySpark and SQL.
  • Build and manage data lakes using Azure Data Lake Storage.
  • Orchestrate workflows using Azure Data Factory.
  • Design and implement dimensional data models.
  • Optimize Databricks jobs for performance and cost efficiency.
  • Ensure data quality, governance, and security.

Skills

Azure Databricks
Python
PySpark
SQL
Azure Data Factory
Delta Lake
CI/CD
Git version control

Job description

Job Summary:

We are seeking a skilled Azure Data Engineer with strong hands-on experience in Databricks to design, develop, and optimize scalable data solutions within the Microsoft Azure ecosystem. The ideal candidate should have expertise in ETL/ELT pipeline development, Lakehouse architecture, and cloud-based data engineering practices.

Key Responsibilities:
  • Design and develop scalable ETL/ELT pipelines using Azure Databricks.
  • Implement Lakehouse architecture using Delta Lake (Bronze / Silver / Gold layers).
  • Develop batch and streaming data pipelines using PySpark and SQL.
  • Build and manage data lakes using Azure Data Lake Storage (ADLS).
  • Orchestrate workflows using Azure Data Factory (ADF).
  • Design and implement dimensional data models (Star Schema / Snowflake Schema).
  • Optimize Databricks jobs for performance and cost efficiency.
  • Ensure data quality, governance, and security using Azure best practices.
  • Collaborate with analytics and BI teams to deliver curated datasets for reporting.
Required Skills:
  • Strong hands-on experience with Azure Databricks (Notebooks, Workflows, Delta Tables).
  • Proficiency in Python, PySpark, and SQL.
  • Experience with Azure Data Factory (ADF) and ADLS.
  • Good understanding of Delta Lake and Medallion Architecture.
  • Knowledge of CI/CD and Git version control.
Preferred Certifications:
  • Databricks Data Engineer Professional (Preferred)
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks data engineer
Databricks data engineer

NYX TECH SOLUTION • Pune District

On-site
INR 1,200,000 - 2,100,000
Databricks Engineer
Databricks Engineer

DATAECONOMY Inc • Pune District

On-site
INR 2,500,000 - 4,000,000
Data Engineer-Azure Databricks
Data Engineer-Azure Databricks

Qloron • Mumbai

On-site
INR 1,200,000 - 1,800,000
Azure Data Engineer
Azure Data Engineer

InfoBeans • Indore District, Pune District

On-site
INR 3,000,000 - 5,400,000
Senior Data Brick Engineer
Senior Data Brick Engineer

Zenithive Engineering • Ahmedabad District

On-site
INR 1,200,000 - 2,400,000
Sr. Databricks Engineer
Sr. Databricks Engineer

ExlService Holdings, Inc. • Pune District

Hybrid
INR 3,500,000 - 6,500,000
Lead Data Engineer
Lead Data Engineer

Mployee.me • Mumbai

On-site
INR 1,500,000 - 2,100,000
Lead Data Engineer
Lead Data Engineer

IRT Digital Analytics Solutions • Mumbai Suburban

On-site
INR 1,000,000 - 1,500,000
Data Engineer-Information Technology
Data Engineer-Information Technology

Emcure Pharmaceuticals Limited • Pune District

On-site
INR 1,400,000 - 2,000,000
Databricks - Azure Data engineer
Databricks - Azure Data engineer

Pwc India • India

Hybrid
INR 1,400,000 - 2,200,000