Senior Data Platform and Integration Engineer

Sampoorna Consultants; Mumbai; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Sampoorna Consultants in Mumbai (Juinagar) invites a Senior Data Platform and Integration Engineer to lead data architecture and integration initiatives in a hybrid setting. The role focuses on scalable data solutions across cloud platforms and strong governance of data flows.

You will shape API-first strategies, data models, and governance, while guiding CI/CD pipelines and cross-functional collaboration in an international, agile environment.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, IT, or related field.
• 6+ years of professional data engineering and cloud integration experience.
• Strong SQL and Python skills; knowledge of R/Java is a plus.
• Deep experience with Azure and Snowflake architectures and optimization.

Responsibilities

• Translate business requirements into scalable data solutions.
• Define target architecture for enterprise data platforms across Azure, Snowflake, Databricks and SAP BTP.
• Establish API-first integration strategy and govern its adoption.
• Design and govern secure data marketplace with classification, lineage and access policies.
• Architect standards and patterns for data ingestion, transformation, and distribution.

Skills

SQL

Python

REST APIs

Kafka

Agile methodologies

Education

Bachelors or Masters degree in Computer Science, Data Engineering, Information Technology, or a related field

Tools

Azure Data Factory

Databricks

Snowflake

SAP BTP

GitHub Actions

Azure DevOps

Microsoft Purview

Job description

Senior Data Platform and Integration Engineer - J50692

Role & responsibilities

Job Location: Juinagar, Navi Mumbai
Work Mode: Hybrid (3 days/week in office)

Job Responsibilities

• Collaborate with business stakeholders, product owners and leadership to translate business requirements into scalable data solutions.
• Define and evolve the target architecture for companies enterprise data platform spanning Azure, Snowflake, Databricks and SAP BTP.
• Establish an API-first integration strategy (REST, event-driven, microservices) and govern its adoption across teams.
• Drive the Clean Core strategy, enabling agile side-by-side extensions through SAP BTP while protecting the SAP S/4HANA core.
• Design and govern a secure Data Marketplace with automated classification, lineage and access policies using Microsoft Purview and Snowflake Horizon.
• Define architectural standards, design patterns, and best practices for data ingestion, transformation, and distribution.
• Evaluate and recommend emerging technologies (Microsoft Fabric, Snowflake Cortex/Intelligence, Databricks Genie, RAG/AI) to advance the platform roadmap.

Hands On Experience

• Design, develop, and maintain scalable ETL/ELT pipelines for data ingestion, transformation, and distribution across cloud environments.
• Build and manage integrations between SAP and non-SAP enterprise systems and cloud data platforms (Azure Data Factory, Databricks, Snowflake).
• Implement real-time data streaming and Change Data Capture (CDC) mechanisms using Kafka, Azure Event Hub, or similar technologies.
• Develop API-based and event-driven integration solutions, including authentication (OAuth2, OIDC) and API gateway configuration.
• Design advanced data models (relational, star, snowflake schemas) optimized for analytical workloads in Snowflake and Databricks.
• Automate deployment and lifecycle management using CI/CD pipelines (Azure DevOps, GitHub Actions, or equivalent).
• Optimize pipeline performance, scalability, and cost efficiency; troubleshoot and resolve production issues.
• Implement data governance, security controls, encryption and lineage tracking within the platform.

Qualification

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Technology, or a related field.
• 6+ years of professional experience in data engineering, data platform architecture, or cloud-based integration — with a demonstrable mix of strategic design and hands‑on implementation.
• Strong proficiency in SQL and Python; additional experience with R or Java is a plus.
• Deep hands‑on experience with Microsoft Azure services (Data Lake, Data Factory, Databricks) and Snowflake architecture and optimization.
• Proven expertise in ETL/ELT frameworks and tools, including batch, CDC and streaming patterns.
• Strong knowledge of API-driven architectures, REST APIs, event-driven messaging (Kafka, Event Hub, Service Bus), and authentication protocols (OAuth2, OIDC).
• Experience integrating SAP systems (S/4HANA, BTP, Datasphere) with cloud data platforms.
• Solid understanding of data governance, security encryption and lineage principles.
• Experience with CI/CD practices and infrastructure-as-code.
• Strong analytical, communication, and stakeholder management skills; comfortable working in cross-functional, international teams using agile methodologies.

Preferred Skills & Experience

• Experience with Microsoft Fabric and Power Platform / Power BI.
• Hands‑on exposure to AI/ML capabilities on Snowflake (Cortex, Intelligence), Databricks (Genie), or SAP Joule.
• Relevant certifications in Azure, Snowflake or Databricks.
• Experience in regulated industries such as pharmaceuticals or healthcare
• Understanding of Pharma 4.0 (the pharmaceutical‑industry analog to Industrie 4.0) — digitalization of GxP‑regulated manufacturing and quality processes, including MES/LIMS integration, data integrity and connectivity between shop‑floor (OT) and enterprise (IT) systems.