Principal Data Engineer

OSI Digital; Hyderabad; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

OSI Digital in Hyderabad is seeking a Lead Data Engineer with 7 to 8 years of experience to architect, build, and maintain robust data pipelines. The role requires deep expertise bridging Oracle ERP/OBIA with modern cloud platforms like Snowflake and Databricks, and you will lead the data engineering team through conception to deployment.

You will mentor junior engineers, drive ETL/ELT workflows, and ensure scalable architectures, end-to-end data quality, and performance tuning.

Qualifications

• 7–8 years of data engineering experience.
• Hands-on leading data projects end-to-end.
• Expertise bridging Oracle ERP/OBIA to cloud.

Responsibilities

• Lead data engineering team and mentor engineers.
• Design, build, and deploy scalable data pipelines.
• Migration of legacy Oracle environments to Snowflake/Databricks.

Skills

SQL

Python

PySpark

ETL/ELT

Data Warehousing

Leadership

Cloud Platforms

Tools

Snowflake

Databricks

ODI

OBIA

Oracle ERP/Apps

Job description

Job Description

Role Overview

We are seeking a highly skilled, hands-on Lead Data Engineer with 7 to 8 years of experience to join our data engineering team in Hyderabad. In this role, you will act as a hardcore technical expert and a team leader, capable of architecting, building, and maintaining robust data pipelines while independently driving projects from conception to deployment. The ideal candidate possesses a unique blend of legacy and modern data stack expertise—specifically bridging Oracle ERP/OBIA systems with modern cloud data platforms like Snowflake and Databricks.

Location: Hyderabad

Experience: 7 – 8 Years

Role Type: Full-time, Technical Development & Leadership

Key Responsibilities

Technical Leadership & Delivery

• Act as the technical anchor for the data engineering team, providing architectural guidance, code reviews, and mentoring junior engineers.
• Independently gather requirements, design, develop, and deploy scalable data pipelines and ETL/ELT workflows.
• Drive the migration and integration of legacy Oracle data environments into modern cloud data platforms (Snowflake/Databricks).

Data Pipeline & Platform Engineering

• Architect and implement high-performance data warehouses and lakehouses using Snowflake and Databricks.
• Write highly optimized, scalable code using Python and PySpark for complex data transformations and streaming/batch processing.
• Design and manage data integration workflows using Oracle Data Integrator (ODI) and modern pipeline tools.

Oracle Techno-Functional Domain Expertise

• Utilize deep techno-functional knowledge of Oracle ERP / Oracle Apps modules (e.g., Financials, SCM, HRMS) to understand source data structures.
• Leverage experience with OBIA (Oracle Business Intelligence Applications) to extract, model, and deliver business-critical analytics.
• Write complex, high-performance SQL queries, stored procedures, and performance-tuning scripts.

Technical Skills

• Languages: Expert-level proficiency in SQL and Python.
• Strong hands-on experience with PySpark, Databricks, and Snowflake (including Snowpipe, tasks, and streams).
• Proven track record with ODI, OBIA, and a strong techno-functional understanding of Oracle ERP/Apps schemas and business logic.
• Strong understanding of Data Warehousing concepts, Star/Snowflake schemas, and Delta Lake architecture.

Leadership & Soft Skills

• Demonstrated ability to lead projects independently with minimal supervision.
• Experience managing/leading a small to mid-sized team of data engineers.
• Excellent communication skills to articulate technical designs to both technical teams and business stakeholders.
• Strong problem-solving mindset with a "hardcore technical" approach to debugging and performance optimization.