Senior Data Engineer – Databricks

ApplyMint; Bengaluru; Hybrid; INR 2,800,000 - 7,000,000; Full time

Job summary

ApplyMint is seeking a Senior Data Engineer – Databricks in Bengaluru (HSR Layout) for a Switzerland-based commodity client. The role requires hands-on Data Engineering with Databricks, PySpark, Python, SQL, and AWS, along with leadership and stakeholder management.

The ideal candidate will own data products from design through production and drive batch and streaming pipelines while optimizing for performance, reliability, and cost. Hybrid work mode applies with 3 days in office.

Qualifications

• 14 to 20 years of Data Engineering experience.
• Databricks and Apache Spark / PySpark expertise.
• Python and SQL proficiency.
• AWS Cloud expertise and Lakehouse architecture.
• ETL / ELT and distributed data processing.
• Batch and streaming pipelines.
• Data pipeline optimization and modeling.
• CDC and incremental processing.
• Git, CI/CD and testing fundamentals.
• Data quality, monitoring and observability.
• Technical leadership and stakeholder management.

Responsibilities

• Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
• Own data products from design through production.
• Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
• Optimize pipelines for performance, scalability, reliability, and cost.
• Design scalable data architectures and data models.
• Implement data quality, monitoring, lineage, and CI/CD practices.
• Lead technical discussions and mentor engineering teams.
• Collaborate with business stakeholders, architects, product owners, and engineering teams.
• Remain hands-on while providing technical leadership.

Skills

Databricks

PySpark

Python

SQL

AWS

Lakehouse

ETL/ELT

Batch processing

Streaming

Data Modeling

Data Quality

Git/CI-CD

Leadership

Stakeholder management

Job description

Job Title : Senior Data Engineer – Databricks

Experience : 14 to 20 Years

Location : HSR Layout, Bangalore

Work Mode : Hybrid – 3 Days WFO

Shift : 11:30 AM – 07:30 PM IST

Positions : 2

Notice Period : Immediate Joiners Only

Interview : 1 Technical Round + 2 Client Rounds

Role Overview :

We are looking for a Senior Data Engineer to build and lead enterprise-scale data platforms for a Switzerland-based commodity client.

The role requires a strong hands-on Data Engineering professional with expertise in Databricks, PySpark, Python, SQL, and AWS, along with technical leadership and stakeholder management experience.

Must-Have Skills :

• 14 to 20 years of Data Engineering experience
• Databricks & Apache Spark / PySpark
• Python & SQL
• AWS Cloud
• Lakehouse Architecture
• ETL / ELT & Distributed Data Processing
• Batch & Streaming Pipelines
• Data Pipeline Optimization & Data Modeling
• CDC & Incremental Processing
• Git, CI/CD & Testing
• Data Quality, Monitoring & Observability
• Technical Leadership & Stakeholder Management

Key Responsibilities :

• Design and build scalable data pipelines using Databricks, PySpark, Python, SQL, and AWS.
• Own data products from design through production.
• Develop batch / streaming pipelines and reusable ETL / ELT frameworks.
• Optimize pipelines for performance, scalability, reliability, and cost.
• Design scalable data architectures and data models.
• Implement data quality, monitoring, lineage, and CI/CD practices.
• Lead technical discussions and mentor engineering teams.
• Collaborate with business stakeholders, architects, product owners, and engineering teams.
• Remain hands-on while providing technical leadership.

Ideal Candidate :

A 14 to 20 years experienced, hands-on Data Engineering leader with strong Databricks + PySpark + AWS expertise, excellent communication, stakeholder management, and experience delivering enterprise-scale data platforms.

Super Urgent : Only Bangalore-based immediate joiners.