Senior Data Engineer

Valuemomentum; Hyderabad, Pune District, Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

ValueMomentum is hiring a Senior/Lead Data Engineer to design and develop scalable data pipelines using Azure Databricks, Azure Data Factory, Delta Lake and DLt. You will work with PySpark, SQL and Delta Live Tables to build robust data processing solutions.

The role requires 6–10 years of experience, with locations in Hyderabad, Pune, Bangalore and Coimbatore. Work mode is office-based 4 days a week, with immediate to 15 days notice period and immediate joiners preferred.

Qualifications

• 6–10 years of experience in data engineering or related field.
• Experience designing and building scalable data pipelines using Databricks, ADF, DLt, SQL and PySpark.
• Strong communication and collaboration with cross-functional teams.

Responsibilities

• Design and develop scalable ETL/data pipelines using Azure Databricks, ADF, and ADLS.
• Build and optimize Delta Live Tables (DLT) pipelines for reliable data processing.
• Develop data processing solutions using SQL, Python, and PySpark.
• Work with ADLS, Databricks, Synapse, and Azure SQL DB.
• Follow DevOps and CI/CD practices for deployment.

Skills

Python

SQL

PySpark

Data pipeline design

ETL

Big data processing

DevOps collaboration

Tools

Azure Databricks

Azure Data Factory

Delta Lake

Delta Live Tables

ADLS

Synapse

Azure SQL DB

Databricks

CI/CD tooling

Job description

Were Hiring | Senior/Lead Data Engineer

We are looking for experienced Senior/Lead Data Engineers with strong technical and communication skills. Immediate Joiners are highly preferred

Experience: 6 to 10 Years
Location: Hyderabad | Pune | Bangalore | Coimbatore
Work Mode: Work from Office 4 Days/Week
Notice Period: Immediate to 15 Days
Immediate Joiners are highly preferred

Role Overview

You will be responsible for designing and developing scalable data pipelines using Azure Databricks, Azure Data Factory, Delta Lake, PySpark, SQL, and Delta Live Tables (DLT).

Role Overview

• Design and develop scalable ETL/data pipelines using Azure Databricks, ADF, and ADLS. Strong Data Bricks Architecture
• Build and optimize Delta Live Tables (DLT) pipelines for reliable and scalable data processing.
• Develop efficient data processing solutions using SQL, Python, and PySpark.
• Work with ADLS, Databricks, Synapse, and Azure SQL DB.
• Develop data ingestion, processing, and analytical pipelines for big data and relational databases.
• Follow DevOps and CI/CD practices for deployment.

About Value Momentum

We are ValueMomentum, an IT services and consulting company focused on the Property & Casualty Insurance industry. Since 2000, we've been helping insurance companies in the US, Canada, and Europe improve their business using AI, cloud, and digital technologies. We work with over 100 insurance clients and provide opportunities to work on enterprise projects with the latest technologies while building a strong career in the insurance domain.