Senior Data Engineer

Papigen; India; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Papigen in India seeks a Senior Data Engineer with 15+ years of experience, specializing in Oracle PL/SQL and large-scale Azure cloud migrations to independently own complex migration workstreams.

The role involves reverse-engineering legacy logic, designing and implementing Azure-based data pipelines, and ensuring data integrity and traceability throughout migration lifecycles. You will collaborate with data modelers and architects and produce detailed design artifacts.

Qualifications

• 15+ years in enterprise data migration, modernization, and integration.
• Deep Oracle PL/SQL and database behavior understanding.
• Hands-on Azure data stack skills including Data Factory, Synapse, and Delta Lake.
• Experience designing and operating ETL/ELT pipelines for batch and real-time processing.

Responsibilities

• Reverse-engineer legacy PL/SQL code and data logic.
• Refactor to support Azure-based migration and integration workflows.
• Design and implement Azure data pipelines and data movement solutions.
• Perform source-to-target mapping, data reconciliation, and validation.
• Create migration design docs, LLD, and validation reports.
• Guide testing and downstream teams on migration logic and data validation.

Skills

Oracle PL/SQL

Azure Data Factory

Azure Synapse

Azure Databricks

Python

SQL

Data Modeling

ETL/ELT pipelines

Delta Lake

Spark

Azure SQL Database

Informatica

SSIS

Azure DevOps

Tools

Informatica

SSIS

Job description

Role Overview

We are looking for a Senior Data Engineer (15+ years) with deep hands-on experience in database development, Oracle PL/SQL, and large-scale Azure cloud migration to independently own and deliver complex migration and integration workstreams with minimal supervision. The role covers reverse-engineering legacy database logic, designing and implementing Azure-based data pipelines, and ensuring functional equivalence, data integrity, and traceability throughout the migration lifecycle.

Scope of Work

• Independently analyze, interpret, and reverse-engineer existing PL/SQL code, database objects, and data processing logic from legacy systems.
• Adapt, refactor, or rewrite extracted logic to support Azure-based data migration and integration workflows, ensuring functional equivalence, data integrity, and traceability.
• Design and implement data movement, transformation, and orchestration pipelines using Azure Data Factory and related Azure services.
• Perform detailed source-to-target mapping, data transformation analysis, reconciliation, and validation as part of large-scale data migration initiatives.
• Collaborate with data modelers and architects to align conceptual, logical, and physical data models with migration and integration requirements.
• Produce and maintain migration design documents, Low-Level Design (LLD), mapping specifications, unit test plans, and validation reports.
• Provide technical guidance to testing, integration, and downstream teams on migration logic, data validation strategies, and testing expectations.
• Support integration testing and UAT by validating data consistency and correctness across upstream and downstream systems.
• Perform in-depth troubleshooting, root cause analysis, and resolution of migration-related data issues across environments.
• Ensure adherence to data governance standards, security controls, performance guidelines, and cloud best practices.
• Proactively manage work items, timelines, dependencies, and risks; communicate issues and trade-offs to technical and business stakeholders.
• Participate in SCRUM ceremonies; work closely with onsite and offshore teams while maintaining ownership of assigned deliverables.
• Assist with documentation and artifacts for security clearance, release readiness, and production deployment.

Skills & Experience Required

• 15+ years of overall professional experience with strong focus on enterprise data migration, system modernization, and integration initiatives.
• 8-10 years of experience in Data Modelling, Data/Information Architecture, Metadata Management, Master Data Management, Data Governance, and Data Quality.
• Deep understanding of Oracle PL/SQL logic and database behavior; demonstrated ability to analyze and reverse-engineer complex legacy implementations.
• Expertise in Azure platforms - Azure Databricks, ADLS, Delta Lake, and their various components.
• In-depth hands-on experience with the Microsoft Azure data stack: Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Functions, Logic Apps, Event Hubs, Function Apps, APIM, and Web Apps.
• Strong experience designing ETL/ELT pipelines and data flows using Azure Data Factory (primary); SSIS and Informatica as additional skills.
• In-depth knowledge of designing ETL pipelines for batch and real-time processing in Azure Data Factory.
• Thorough understanding of data lakes, Delta Lakes, and raw/enriched/curated layer concepts and ETL within the Azure framework; experience executing end-to-end projects focusing on Azure Synapse and Delta Lake.
• Proficiency in Python, SQL, Spark notebooks, and Scala; strong development and design skills in MS SQL Server and Oracle.
• Experience with Big Data architecture concepts, data sourcing, ingestion, curation, and storage mechanisms; real-time and near-real-time data warehousing concepts.
• Experience leveraging Azure Automation, Azure PowerShell scripting, AzCopy, Azure DevOps, and ARM Templates.
• Experience handling large-volume data migrations, reconciliation, validation, and cross-system data consistency checks.
• Strong understanding of data modelling concepts - relational structures, surrogate and composite keys, cross-reference tables, and migration-friendly data designs.
• Experience with Salesforce migration is a plus.
• Demonstrated ability to work as a senior individual contributor, independently owning complex migration workstreams.
• Strong analytical and root cause analysis skills; excellent written and verbal communication with technical and non-technical stakeholders.
• Highly organized with strong ownership of deliverables, documentation, and timelines.

Skills: adls,data governance,azure synapse,azure devops,azure functions,apim,azure automation,azcopy,ssis,delta lake,etl,ms sql server,data architecture,azure sql,elt,sql,data warehouse,oracle pl/sql,azure data factory,data quality,python,azure databricks,azure powershell,informatica,data modelling,function apps,metadata management,logic apps