Senior Data Engineer

Pri India It Services; Pune District; Hybrid; INR 1,400,000 - 2,200,000; Full time

Job summary

Pri India It Services is hiring a Senior Data Engineer in Pune on a hybrid model. The role focuses on designing, building, and optimizing scalable data pipelines and modern data platform solutions across ETL/ELT, big data tech, cloud platforms, and governance.

The ideal candidate has strong hands-on experience with Spark, Python, SQL, and Databricks, plus data warehousing and real-time data capabilities. Collaboration with analytics and engineering teams is essential.

Qualifications

• 6+ years of experience in Data Engineering or Big Data environments.
• Strong hands-on experience with Spark, Python, SQL, and Databricks.
• Experience building enterprise-scale data pipelines and distributed processing systems.
• Expertise in ETL/ELT frameworks and cloud-based data platforms.
• Strong problem-solving, communication, and stakeholder management skills.

Responsibilities

• Build and maintain scalable batch and near real-time data pipelines.
• Develop data ingestion, transformation, and orchestration workflows.
• Support data lake and lakehouse modernization initiatives.
• Implement data quality, governance, and lineage solutions.
• Collaborate with Product, Architecture, Engineering, and Analytics teams.
• Troubleshoot production issues and optimize platform performance.
• Support analytics, reporting, and AI-driven data initiatives.

Skills

Python, PySpark, SQL

Apache Spark, Databricks

Hive, Hadoop, Cloudera

Azure, Microsoft Fabric, OneLake

SSIS, SQL Server, Stored Procedures

ETL/ELT, Data Warehousing

Data Quality, Metadata, Governance & 1

Real-time/Streaming Data Pipelines

Power BI (Preferred)

Job description

Senior Data Engineer

Location: Pune (Hybrid)
Experience: 6+ Years

Job Description

We are hiring a Senior Data Engineer to design, develop, and optimize scalable data pipelines and modern data platform solutions. The ideal candidate should have strong expertise in data engineering, ETL/ELT processes, big data technologies, cloud platforms, and data governance.

Key Skills:

• Python, PySpark, SQL
• Apache Spark, Databricks
• Hive, Hadoop, Cloudera
• Azure, Microsoft Fabric, OneLake
• SSIS, SQL Server, Stored Procedures
• ETL/ELT, Data Warehousing
• Data Quality, Metadata, Governance & Lineage
• Real-time/Streaming Data Pipelines
• Power BI (Preferred)

Responsibilities:

• Build and maintain scalable batch and near real-time data pipelines.
• Develop data ingestion, transformation, and orchestration workflows.
• Support data lake and lakehouse modernization initiatives.
• Implement data quality, governance, and lineage solutions.
• Collaborate with Product, Architecture, Engineering, and Analytics teams.
• Troubleshoot production issues and optimize platform performance.
• Support analytics, reporting, and AI-driven data initiatives.

Requirements:

• 6+ years of experience in Data Engineering or Big Data environments.
• Strong hands-on experience with Spark, Python, SQL, and Databricks.
• Experience building enterprise-scale data pipelines and distributed processing systems.
• Expertise in ETL/ELT frameworks and cloud-based data platforms.
• Strong problem-solving, communication, and stakeholder management skills.

Preferred Qualifications:

• Experience with Microsoft Fabric, OneLake, and cloud-native platforms.
• Exposure to observability/log streaming tools like Cribl.
• Experience supporting Analytics, Reporting, AI, or ML workloads.
• Ability to mentor team members and drive technical initiatives.