Lead Data Engineer

R Systems; India; Presencial; INR 1 500 000 - 2 000 000; Tempo integral

Resumo da oferta

A technology solutions provider in India is looking for a highly skilled Google Cloud Platform (GCP) Data Engineer to design and implement enterprise-grade data solutions. The successful candidate will lead a team, develop ETL/ELT pipelines, and integrate SAP data with GCP. Responsibilities include developing SQL queries, implementing CI/CD pipelines, and ensuring data integrity during migrations. The ideal candidate has 8-10 years of experience, strong SQL and Python skills, and expertise in SAP data integration.

Qualificações

• 8-10 years of experience with GCP BigQuery, Dataflow, Cloud Storage.
• Strong SQL and Python programming skills.
• Hands-on experience with SAP data extraction and modeling.

Responsabilidades

• Lead a team of data engineers in building ETL/ELT pipelines.
• Develop complex SQL queries for analytics and performance tuning.
• Implement CI/CD pipelines for data workflows.

Conhecimentos

GCP BigQuery

SQL

Python

SAP data integration

DevOps tools

Descrição da oferta de emprego

We are seeking a highly skilled Google Cloud Platform (GCP) Data engineer role with SAP data integration expertise to design, implement, and oversee enterprise‑grade data solutions. The ideal candidate will combine deep expertise in cloud data platforms, data governance, security, and data modeling with hands‑on experience in ETL/ELT pipelines, SAP data extraction, system migrations, and analytics. This role will collaborate with business stakeholders, and engineering teams to create a robust, scalable, and cost‑effective data ecosystem that bridges SAP and GCP environments.

Key Responsibilities

• Lead and mentor a team of data engineers in building ETL/ELT pipelines for SAP and other ERP sources into GCP
• Set engineering standards, best practices, and coding guidelines.
• Provide technical direction, code reviews, and support for complex data solutions.
• Collaborate with project managers, provide the estimates, track the progress, remove roadblocks to ensure timely completion of work.
• Collaborate with BI teams, Data analyst to enable reporting solution

5. Programming & Analytics

• Develop complex SQL queries for analytics, transformations, and performance tuning.
• Build automation scripts and utilities in Python.

6. System Migration

• Lead on‑premise to cloud migrations for enterprise data platforms [SAP BW/Bobj]
• Manage migration of SAP datasets to GCP ensuring data integrity and minimal downtime.

8. DevOps for Data

• Implement CI/CD pipelines for data workflows using GitHub Actions, Cloud Build, and Terraform.
• Apply infrastructure‑as‑code principles for reproducible and scalable deployments.
• Design and develop conceptual, logical, and physical data models for enterprise systems.
• Translate business requirements into data entities, attributes, relationships, and constraints.
• Build and maintain dimensional models (Star/Snowflake schema) for data warehouses and BI reporting.
• Develop data models for data lake / lakehouse environments (BigQuery, Snowflake, Azure Synapse, Databricks).
• Define and document data standards, naming conventions, and data definitions.
• Collaborate with Data Engineering teams to ensure models are implemented accurately in ETL/ELT pipelines.
• Work with BI teams to optimize models for reporting tools such as Power BI, Tableau, SAP BW, etc.
• Ensure data models comply with data governance, security, and compliance requirements.
• Create and maintain documentation including ERDs, data dictionaries, and lineage diagrams

Preferred Skills

• 8-10 years of proven experience with GCP BigQuery, Composer, Cloud Storage, Pub/Sub, Dataflow.
• Strong SQL and Python programming skills.
• Hands‑on experience with SAP data extraction, modeling, and integration from ERP, BW, and/or HANA systems.
• Knowledge of data governance frameworks and security best practices.
• Familiarity with DevOps tools for data.
• Understanding of Google Cortex Framework for SAP‑GCP integrations.