Azure Databricks Data Engineer

Exavalu Solutions India Pvt Ltd; India; On-site; INR 1,000,000 - 1,500,000; Full time

Benefits offered by this job

Flexible work environment

Inclusive culture

Welcome back program

Job summary

A tech solutions company is looking for a data engineer to work remotely in India. The role involves designing and implementing end-to-end data pipelines using Azure services and Databricks. Key responsibilities include data ingestion, transformation, and optimizing data models for performance. Applicants should have hands-on experience with Azure Databricks and strong analytical skills. The company promotes flexibility and diversity, welcoming all qualified candidates.

Qualifications

• Hands-on experience with Azure Databricks.
• Optimizing data pipelines for performance and scalability.
• Solid understanding of distributed data processing concepts.

Responsibilities

• Designing and implementing end-to-end data pipelines using Azure services.
• Implementing data governance principles using Unity Catalog.
• Creating and implementing data ingestion patterns in a medallion architecture.

Skills

Azure Databricks

Data ingestion

Data transformation

PySpark

Data governance

Job description

Exavalu offers a permanent remote working model. This remote position involves designing and implementing end-to-end data pipelines using Azure‑native services and Databricks. The role focuses on building scalable, high‑performance data platforms, defining robust data frameworks, and partnering with stakeholders to translate business requirements into reliable data solutions.

• Implement data governance principles using the Unity Catalog.
• Create and implement data ingestion and data integration patterns in a medallion architecture.
• Create PySpark notebooks and procedures for advanced data transformation.
• Handle performance tuning aspects in Databricks and Azure SQL DBs.

Requirements

Required Skills & Qualifications

• Hands‑on experience with Azure Databricks.
• Hands‑on expertise in data ingestion, transformation, and orchestration frameworks.
• Hands‑on experience in building Insurance‑specific data models.
• Proven ability to optimize data pipelines for performance, scalability, and cost efficiency.
• Solid understanding of distributed data processing concepts.

Preferred Skills & Qualifications

• Hands‑on experience with PySpark for large‑scale data processing.
• Experience defining and enforcing best practices for Databricks workloads and Spark‑based pipelines.
• Strong analytical and problem‑solving skills.
• Excellent communication skills to effectively work with cross‑functional stakeholders.
• Prior experience working in Insurance P&C cloud‑based data & analytics projects.

Exavalu also promotes flexibility, adapting to the needs of employees, customers, and the business. We offer a welcome back program to help individuals return to the mainstream after a prolonged absence due to health or family reasons. We are committed to building a diverse and inclusive workforce. We welcome applications for employment from all qualified candidates, regardless of race, colour, gender, national or ethnic origin, age, disability, religion, sexual orientation, gender identity or any other status protected by applicable law. We nurture a culture that embraces all individuals and promotes diverse perspectives, where you can make an impact and grow your career.