Databricks Developer

Xceedance; Gurgaon; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Xceedance is seeking a Senior Databricks Developer to join our data engineering team in Gurgaon/Noida. The role focuses on building scalable data pipelines using Spark on Databricks, integrating with Azure Data Lake and Delta Lake, and delivering robust data solutions for insurance and analytics projects.

The ideal candidate has 5+ years in data engineering, strong Spark/PySpark and SQL skills, and hands-on Databricks experience. Azure cloud expertise and CI/CD familiarity are a plus.

Qualifications

• 5+ years of experience in data engineering or big data development.
• Strong proficiency in Apache Spark, PySpark, and SQL.
• Hands-on experience with Databricks platform (notebooks, jobs, clusters).
• Experience with cloud platforms (Azure) and cloud-native data services.
• Familiarity with Delta Lake, MLflow, and Databricks Workflows.
• Knowledge of CI/CD practices and version control (Git).
• Strong problem-solving and communication skills.
• Databricks certification preferred.
• Experience with data modeling, data warehousing, and BI tools.
• Exposure to DevOps, Terraform, or Infrastructure as Code (IaC).
• Experience working in Agile/Scrum environments.

Responsibilities

• Design, develop, and optimize data pipelines using Apache Spark on Databricks.
• Implement ETL/ELT workflows to ingest, transform, and load data from various sources.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
• Ensure data quality, integrity, and governance across all pipelines.
• Monitor and troubleshoot performance issues in Databricks notebooks and jobs.
• Integrate Databricks with cloud services (Azure Data Lake) and enterprise data platforms.
• Participate in code reviews, documentation, and agile ceremonies.

Skills

Apache Spark

PySpark

SQL

Databricks

Azure

Data pipelines

Tools

Databricks

Azure Data Lake

Delta Lake

MLflow

Git

Terraform

Job description

About Xceedance:

Xceedance provides strategic operations support, technology, and data services to drive efficiencies for
insurance organizations worldwide. The company helps insurers launch products, implement intelligent
technology, deploy advanced analytics, and achieve business process optimization.
We are committed to adding direct value in the business of insurance and help insurers launch new
products, drive operations, implement intelligent technology, deploy advanced analytic capabilities, and
achieve business process optimization.
For more information, visit www.xceedance.com.

Our Vision & Strategic Focus:

To help catalyze insurance ecosystems for the benefit of the society.

• Global Insurance expertise and a customer centric approach
• Vertical focused and technology enabled
• Learning Organization
• People – First Culture

Job Summary:

We are seeking a skilled and experienced Databricks Developer to join our data engineering
team. The ideal candidate will have a strong background in big data technologies, cloud platforms (preferably
Azure), and hands-on experience with Databricks for building scalable data pipelines and analytics solutions.

Position Title: Senior Analyst Programmer

Experience: 3-6 years

Location: Gurgaon/Noida

Roles and Responsibilities:

• Design, develop, and optimize data pipelines using Apache Spark on Databricks.
• Implement ETL/ELT workflows to ingest, transform, and load data from various sources.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
• Ensure data quality, integrity, and governance across all pipelines.
• Monitor and troubleshoot performance issues in Databricks notebooks and jobs.
• Integrate Databricks with cloud services (Azure Data Lake) and enterprise data platforms.
• Participate in code reviews, documentation, and agile ceremonies.
• Qualification and Experience:
• 5+ years of experience in data engineering or big data development.
• Strong proficiency in Apache Spark, PySpark, and SQL.
• Hands-on experience with Databricks platform (including notebooks, jobs, clusters).
• Experience with cloud platforms (Azure) and cloud-native data services.
• Familiarity with Delta Lake, MLflow, and Databricks Workflows.
• Knowledge of CI/CD practices and version control (Git).
• Strong problem-solving and communication skills.
• Preferred Qualifications:
• Databricks certification (e.g., Databricks Certified Data Engineer
  Associate/Professional).
• Experience with data modeling, data warehousing, and BI tools.
• Exposure to DevOps, Terraform, or Infrastructure as Code (IaC).
• Experience working in Agile/Scrum environments.

What We Offer You

At Xceedance, you will discover the possibility to exceed yourself and grow persistently with us. We offer career development opportunities to our members for a well-rounded development throughout their journey with us.
Xceedance is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status, sexual orientation, gender expression, gender identity or any other characteristic protected by law.