Senior Data Engineer

HR India Solutions; Pune District; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

HR India Solutions is seeking a Senior Data Engineer to join our Pune team. You will design and implement robust data pipelines, collaborating with product teams to deliver data-driven insights.

The ideal candidate has 4–5 years of data engineering experience, strong Python and Spark skills, and hands-on experience with Azure cloud services and data stores such as ADLS and Cosmos. Relocation to Pune is preferred but not mandatory.

Qualifications

• Proficiency in Python and data manipulation tasks.
• Experience with SQL query optimization and DB management.
• Familiarity with Git for version control and collaboration.
• Hands-on with Azure Databricks, PySpark, and Spark concepts.
• Experience with ADLS, EventHub, Cosmos for data storage and streams.
• Knowledge of Azure Cloud services and NoSQL databases.
• System design and data architecture for scalable pipelines.
• REST API integration to connect external data sources.
• 4–5 years of relevant experience in data engineering.
• Stability in career history and willingness to relocate to Pune.
• End-to-end data pipeline development experience.
• Production support and troubleshooting in live environments.

Responsibilities

• Develop end-to-end data pipelines from ingestion to consumption.
• Design robust data architectures for scalable analytics.
• Troubleshoot production data jobs and resolve incidents.

Skills

Python

SQL

Git / Version Control

Azure Databricks

PySpark

Spark Concepts

ADLS

Eventhub

Cosmos

Java

Azure Cloud

REST API Integration

4–5 Years Relevant Experience

Production Support & Troubleshooting

End-to-End Data Pipeline Development

System Design & Data Architecture

Pandas

FastAPI

Requests

Concurrent Processing

Tools

Azure Databricks

PySpark

Spark Concepts

ADLS

Eventhub

Cosmos

Git / Version Control

Pandas

FastAPI

Requests

Concurrent Processing

Job description

Role: SENIOR DATA ENGINEER

Location: Pune / Experience: 46 Years/Age:28 yrs

Role Requirements & Skills Breakdown

Skill / Preference Requirement

Type

Description / Details

Python

Mandatory

Core programming language requirement

Libraries: Pandas, FastAPI, Requests, Concurrent Processing

Mandatory

Data manipulation, API creation, and concurrent execution

SQL

Mandatory

Query optimization and database management

Git / Version Control

Mandatory

Code management and collaboration

Azure Databricks, PySpark, Spark Concepts

Mandatory

Big Data processing and analytics

ADLS, Eventhub, Cosmos

Mandatory

Azure cloud storage, event streaming, and NoSQL databases

System Design & Data Architecture

Mandatory

Designing robust and scalable data infrastructures

Java and OOPs

Good to Have

Object-oriented programming experience

Azure Cloud

Good to Have

General familiarity with broader Azure services

REST API Integration

Good to Have

Connecting and pulling data from external APIs

4–5 Years Relevant Experience

Mandatory

Proven track record in Data Engineering / Data Science

Stable Career History

Mandatory

Demonstrated career longevity with no frequent switching

Preferred Location: Pune

Mandatory

Willingness to work from or relocate to Pune

Production Support & Troubleshooting

Mandatory

Experience managing and resolving live environment issues

End-to-End Data Pipeline Development

Mandatory

Hands-on experience building complete data solutions

Engineering background and Technology