Senior Data Engineer

Insight Global (United States)

Mumbai

On-site

INR 1,200,000 - 1,800,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A leading data solutions firm in Mumbai seeks a highly skilled Senior Data Engineer to build scalable data pipelines and automation frameworks. The ideal candidate will have 5-7 years of experience with Databricks and the Azure ecosystem, demonstrating strong leadership and problem-solving skills. You'll design and optimize data processes, mentor junior engineers, and collaborate cross-functionally. This hands-on role is vital for our EDH initiative and offers the chance to shape our data engineering practices.

Qualifications

  • 5–7 years of hands-on experience in Databricks and Spark-based data engineering.
  • Strong proficiency in the Azure tech stack including Azure Data Lake and Azure Data Factory.
  • Experience leading small teams or mentoring engineers.

Responsibilities

  • Design, develop, and optimize scalable data pipelines using Databricks and Apache Spark.
  • Implement job orchestration and automation using tools like Azure Data Factory.
  • Manage and monitor data workflows, ensuring reliability and performance.

Skills

Databricks
Apache Spark
Azure Data Factory
CI/CD pipelines
Problem-solving

Tools

Azure Functions
Azure Data Lake
Azure Synapse

Job description

Overview

We are seeking a highly skilled and hands-on Senior Data Engineer to join our EDH initiative. This role demands deep expertise in building scalable data pipelines and automation frameworks using Databricks and the Azure ecosystem. The ideal candidate will have a strong engineering mindset, leadership experience, and a passion for solving complex data challenges.

Key Responsibilities
  • Design, develop, and optimize scalable data pipelines using Databricks and Apache Spark
  • Implement job orchestration and automation using tools like Azure Data Factory, Azure Functions, and DevOps
  • Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions
  • Lead and mentor junior engineers, ensuring best practices in coding, testing, and deployment
  • Manage and monitor data workflows, ensuring reliability and performance
  • Contribute to architectural decisions and help shape the future of the EDH platform
Required Qualifications
  • 5–7 years of hands-on experience in Databricks and Spark-based data engineering
  • Strong proficiency in the Azure tech stack: Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Functions, etc.
  • Proven experience in job automation, CI/CD pipelines, and workflow orchestration
  • Solid understanding of data modeling, ETL/ELT processes, and performance tuning
  • Experience leading small teams or mentoring engineers in a fast-paced environment
  • Excellent problem-solving and communication skills
Preferred Qualifications
  • Experience with Delta Lake, Unity Catalog, and MLflow
  • Familiarity with data governance and security best practices in cloud environments
  • Exposure to Agile methodologies and DevOps practices
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Engineer
Senior Databricks Engineer

DATABEAT • Hyderabad

On-site
INR 1,500,000 - 2,500,000
Data Engineer
Data Engineer

Intact Insurance • India

On-site
INR 1,500,000 - 2,300,000
Senior Data Engineer
Senior Data Engineer

QUESTK2 Technologies • Hyderabad

Hybrid
INR 1,400,000 - 2,300,000
Senior Data Engineer
Senior Data Engineer

EduRun Group • Indore

On-site
INR 900,000 - 1,500,000
Senior Data Engineer
Senior Data Engineer

Kanini Software Solutions • Pune District, Chennai, Bengaluru

Hybrid
INR 3,500,000 - 7,000,000
Sr. Databricks Engineer
Sr. Databricks Engineer

ExlService Holdings, Inc. • Pune District

Hybrid
INR 3,500,000 - 6,500,000
Databricks - Data Engineer
Databricks - Data Engineer

Tredence Inc. • Bengaluru

On-site
INR 1,500,000 - 2,500,000
Senior Data Engineer
Senior Data Engineer

EduRun Group • Indore District

On-site
INR 1,500,000 - 2,500,000
Senior Databricks Engineer
Senior Databricks Engineer

Value Vision • Bengaluru

On-site
INR 4,200,000 - 6,600,000
Data Engineer
Data Engineer

Ambiquest Hyderabad • Dadri, Hyderabad, Bengaluru

Hybrid
INR 2,800,000 - 4,600,000