Senior Data Engineer - Level 7

PRI INDIA IT SERVICES PRIVATE LIMITED; Maharashtra; On-site; INR 2,800,000 - 4,200,000; Full time

Job summary

PRI INDIA IT SERVICES PRIVATE LIMITED is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and lakehouse-ready assets using Spark, Python, SQL, Hive, Databricks, and cloud-native technologies.

You will collaborate with Product, TPM, Data Governance, Architect, and Engineering teams to enable trusted, governed data, support AI-driven analytics, and drive modernization across hybrid and cloud environments.

Qualifications

• 6+ years of experience delivering enterprise-scale data engineering
• Strong hands-on experience with Apache Spark, Python, SQL and Databricks
• Experience building and maintaining large-scale data pipelines and distributed data processing systems
• Experience with streaming or near real-time ingestion patterns
• Experience with Hive, Apache Ozone, or similar data integration, Azure, Microsoft Fabric
• Strong understanding of data architecture, ETL/ELT design patterns
• Hands-on experience with Microsoft SQL Server, SSIS, stored procedures, SQL performance tuning
• Experience implementing data quality, governance, metadata, and lineage capabilities
• Proven ability to analyze complex production issues, root cause analysis, and long-term solutions
• Strong communication and collaboration skills
• Demonstrated ability to manage competing priorities in a fast-paced environment
• Strong ownership mindset and commitment to delivering high-quality solutions

Responsibilities

• Design, develop, and support scalable data pipelines and lakehouse-ready data assets
• Build and optimize capabilities supporting the ONE Data Lake and unified data platform
• Develop ingestion, transformation, and orchestration for batch and streaming data
• Enable trusted, governed data through data quality, lineage, and governance standards
• Collaborate with Product, TPM, Data Governance, Architect, and Engineering teams
• Support AI, analytics, reporting, and decisioning use cases with scalable data assets
• Drive modernization across hybrid data environments and cloud
• Improve operational efficiency via automation, monitoring, observability, and self-service
• Troubleshoot complex platform and data issues, perform root cause analysis
• Evaluate emerging technologies to advance data capabilities

Skills

Apache Spark

Python

SQL

Databricks

Cloudera

Hive

Hadoop

Azure

Microsoft Fabric

SSIS

Education

Bachelor's in Computer Science or related field

Tools

Cribl

Ozone

Power BI

Databricks (Tooling)

Job description

• Design, develop, and support scalable batch and near real-time data pipelines, data products, and lakehouse-ready data assets using Spark, Python, SQL, Hive, Databricks, and cloud-native technologies.
• Build and optimize capabilities supporting the ONE Data Lake and Client's unified data platform strategy.
• Develop ingestion, transformation, and orchestration solutions for batch and streaming/near real-time data patterns using technologies such as Cribl, SSIS, Apache Ozone, Cloudera Data Services, Hive, Spark, Azure, Microsoft Fabric, Databricks, and related ecosystem tools.
• Enable trusted, governed, and accessible enterprise data through the implementation of data quality, lineage, and governance standards.
• Partner closely with Product, TPM, Data Governance, Architect, and Engineering teams to deliver strategic business outcomes.
• Support AI, analytics, reporting, and decisioning use cases by delivering scalable and reliable data assets.
• Drive modernization initiatives across hybrid data environments and cloud.
• Improve operational efficiency through automation, monitoring, observability, and self-service capabilities.
• Troubleshoot complex platform and data issues, perform root cause analysis, and implement sustainable solutions.
• Evaluate emerging technologies and identify opportunities to advance Team ONE's data capabilities.

Top Skills

• Apache Spark
• SQL
• Python
• Cloudera
• Hive
• Databricks
• Azure
• Microsoft Fabric
• SSIS
• Hadoop
• ecosystem tools

As a Senior Data Engineer, You Will

• Design, develop, and support scalable batch and near real-time data pipelines, data products, and lakehouse-ready data assets using Spark, Python, SQL, Hive, Databricks, and cloud-native technologies.
• Build and optimize capabilities supporting the ONE Data Lake and Client's unified data platform strategy.
• Develop ingestion, transformation, and orchestration solutions for batch and streaming/near real-time data patterns using technologies such as Cribl, SSIS, Apache Ozone, Cloudera Data Services, Hive, Spark, Azure, Microsoft Fabric, Databricks, and related ecosystem tools.
• Enable trusted, governed, and accessible enterprise data through the implementation of data quality, lineage, and governance standards.
• Partner closely with Product, TPM, Data Governance, Architect, and Engineering teams to deliver strategic business outcomes.
• Support AI, analytics, reporting, and decisioning use cases by delivering scalable and reliable data assets.
• Drive modernization initiatives across hybrid data environments and cloud.
• Improve operational efficiency through automation, monitoring, observability, and self-service capabilities.
• Troubleshoot complex platform and data issues, perform root cause analysis, and implement sustainable solutions.
• Evaluate emerging technologies and identify opportunities to advance Team ONE's data capabilities.

Required Qualifications

• 6+ years of experience delivering enterprise-scale data engineering, data warehousing, or big data solutions.
• Strong hands‑on experience with Apache Spark, Python, SQL and Databricks.
• Experience building and maintaining large-scale data pipelines and distributed data processing systems.
• Experience with streaming or near real-time ingestion patterns, including event/log data collection, routing, transformation, and delivery into enterprise data lake or lakehouse platforms.
• Experience with Hive, Apache Ozone, or similar data integration, Azure, Microsoft Fabric, and orchestration technologies.
• Strong understanding of data architecture, ETL/ELT design patterns, and modern data platform principles.
• Hands‑on experience with Microsoft SQL Server, SSIS packages, stored procedures, SQL performance tuning, and relational database concepts.
• Experience implementing data quality, governance, metadata, and lineage capabilities.
• Proven ability to analyze complex production issues, perform root cause analysis, and implement long‑term solutions.
• Strong communication and collaboration skills with the ability to work effectively across technical and business teams.
• Demonstrated ability to manage competing priorities in a fast‑paced environment.
• Strong ownership mindset and commitment to delivering high‑quality solutions.

Preferred Qualifications

• Experience with Cribl or similar observability/log streaming platforms, including data routing, filtering, enrichment, and delivery to downstream lakehouse or analytics platforms.
• Experience with Microsoft Fabric, OneLake, and cloud-native data platforms.
• Experience with enterprise data governance and metadata management solutions.
• Experience supporting analytics, reporting, AI, or machine learning workloads.
• Experience with Power BI and enterprise reporting environments.
• Experience mentoring engineers and leading technical initiatives.
• Experience working within geographically distributed teams and matrix organizations.

About Team ONE Data Strategy

The ONE Data Strategy team is a core function within Client's ONE Data & Governance organization. Our mission is to deliver a unified operational data strategy and platform across the enterprise by building a modern ONE Data Lake and lakehouse‑aligned architecture that connects batch, streaming and operational data across multiple platforms.

How We Support Client

We serve as both a strategy and delivery organization focused on transforming data into a trusted enterprise asset that powers decision‑making, operational efficiency, governance, AI‑driven innovation, and future business capabilities.

The ONE Data Strategy team delivers value through: Enterprise Data Accessibility; Data Trust and Quality; Platform Enablement and Modernization; Operational Efficiency; Governance and Compliance; AI and Automation Enablement; and Unified Data Platform and Data Lake Capabilities.

Senior Data Engineer - ONE Data Strategy

The ONE Data Strategy team is seeking a highly motivated Senior Data Engineer to help drive Client's enterprise data transformation.

In this role, you will design, build, and optimize scalable data solutions that enable trusted enterprise data, support analytics and AI initiatives, and accelerate adoption of Client's unified data platform. You will work closely with cross‑functional teams to deliver innovative solutions that improve accessibility, governance, reliability, and business value across the data ecosystem.

This role offers the opportunity to influence strategic data initiatives, contribute to enterprise‑scale platforms, and help shape the future of Client's One Data vision.