Lead Data Engineer (Databricks)

Fulcrum Worldwide Software

Coimbatore District

Hybrid

INR 7,000,000 - 9,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Fulcrum Worldwide Software in Coimbatore is seeking a Lead Data Engineer with deep expertise in Databricks, Spark, PySpark, Python and SQL to guide complex data solutions. Immediate joiners preferred and 10–14 years of hands-on delivery are expected.

You will design scalable data pipelines, mentor the team, and drive architectural decisions across lakehouse, Delta Lake, and Medallion architectures, while working with real-time and batch processing using Kafka.

Qualifications

  • 10–14 years of experience in Data Engineering.
  • Strong hands-on experience with Databricks and Spark/PySpark.
  • Experience in solution architecture and pre-sales activities.
  • Experience in building scalable, high-performance data platforms.
  • Strong communication and client-facing skills.

Responsibilities

  • Lead the design and development of scalable data engineering solutions using Databricks.
  • Design and implement data pipelines using Apache Spark, PySpark, Python, and SQL.
  • Work on real-time and batch data processing using Kafka.
  • Design and optimize low-latency data solutions using Apache Pinot.
  • Implement Lakehouse architecture, Delta Lake, and Medallion architecture.
  • Lead solution architecture discussions, POCs, and technical presentations.
  • Collaborate with clients and stakeholders to understand business requirements.
  • Drive technical decisions and mentor the data engineering team.

Skills

Databricks
Apache Spark / PySpark
Python
SQL
Apache Kafka
Apache Pinot
Lakehouse Architecture
Delta Lake / Medallion Architecture

Tools

Airflow
Cloud platforms
DevOps / CI/CD
Pre-sales
Stakeholder management

Job description

Job Description Lead Data Engineer (Databricks)

Location: Coimbatore
Experience: 10–14 Years
Notice Period: Immediate Joiners Preferred

Role Overview

We are looking for an experienced Lead Data Engineer with strong expertise in Databricks, Apache Spark, PySpark, Python, SQL, Kafka, and Apache Pinot. The ideal candidate should have experience in solution architecture, data engineering, pre-sales discussions, and delivering scalable data solutions.

Key Responsibilities
  • Lead the design and development of scalable data engineering solutions using Databricks.
  • Design and implement data pipelines using Apache Spark, PySpark, Python, and SQL.
  • Work on real-time and batch data processing using Kafka.
  • Design and optimize low-latency data solutions using Apache Pinot.
  • Implement Lakehouse architecture, Delta Lake, and Medallion architecture.
  • Lead solution architecture discussions, POCs, and technical presentations.
  • Collaborate with clients and stakeholders to understand business requirements.
  • Drive technical decisions and mentor the data engineering team.
Mandatory Technical Skills
  • Databricks
  • Apache Spark / PySpark
  • Python
  • SQL
  • Apache Kafka
  • Apache Pinot
  • Lakehouse Architecture
  • Delta Lake / Medallion Architecture
Additional Skills
  • Cloud platforms (AWS / Azure / GCP)
  • Data pipeline orchestration (Airflow)
  • DevOps and CI/CD
  • Solution Architecture and Pre-sales
  • Client-facing communication and stakeholder management
Required Experience
  • 10–14 years of overall experience in Data Engineering.
  • Strong hands-on experience with Databricks and Spark/PySpark.
  • Experience in solution architecture and pre-sales activities.
  • Experience in building scalable, high-performance data platforms.
  • Strong communication and client-facing skills.
Preferred Location:

Preferred Location: Coimbatore

Note:

Note: Databricks and Apache Pinot are mandatory skills.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer
Lead Data Engineer

Intellics Global Services • Chennai

Hybrid
INR 2,800,000 - 3,000,000
LEAD DATA ENGINEER - Azure Databricks
LEAD DATA ENGINEER - Azure Databricks

Happiest Minds Technologies • Hyderabad

On-site
INR 2,000,000 - 4,000,000
Lead Data Engineer - Databricks
Lead Data Engineer - Databricks

ShyftLabs • Coimbatore District

On-site
INR 1,800,000 - 2,400,000
Senior Data Engineer
Senior Data Engineer

Coffeebeans Consulting • Bengaluru

On-site
INR 3,000,000 - 6,000,000
Senior Data Engineer
Senior Data Engineer

CoffeeBeans • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Senior Data Engineer Databricks
Senior Data Engineer Databricks

RITWIK IT SERVICES PRIVATE LIMITED • Bengaluru

Hybrid
INR 2,500,000 - 4,000,000
Databricks Engineer
Databricks Engineer

Impronics Technologies • Gurugram District

On-site
INR 4,000,000 - 7,000,000
Lead Databricks Data Engineer
Lead Databricks Data Engineer

Persistent Systems • Bengaluru

Hybrid
INR 3,500,000 - 6,000,000
Hybrid work model
Medical insurance
Learning @ Work
+2
Looking For Lead Data Engineer
Looking For Lead Data Engineer

United Technology • Coimbatore

On-site
INR 2,800,000 - 4,000,000
Databricks Lead Data Engineer
Databricks Lead Data Engineer

R Systems • Bengaluru

On-site
INR 3,000,000 - 4,800,000