We are seeking a Senior Data Engineer to support a major enterprise cloud data transformation project focused on migrating critical Finance and HR reporting workloads from SAP BW on HANA to Google BigQuery. You will take ownership of the data engineering layer, including SAP S/4HANA ingestion, migration of SAP BW transformation logic, BigQuery data modelling, pipeline orchestration, security, data quality, performance optimization, and reconciliation. The role will also support the creation of high-quality, AI-ready datasets for advanced analytics, conversational analytics, and predictive use cases.
Key Responsibilities:
- Analyse existing SAP BW data flows, including DataSources, DSOs, InfoCubes, transformations, ABAP routines, and APDs, and rebuild the required transformation logic using BigQuery SQL.
- Ingest and integrate data from SAP S/4HANA, SAP ECC and/or SAP BW into Google Cloud-based data platforms.
- Design scalable BigQuery data models using raw, curated, and reporting layers.
- Build complex data structures including hierarchies, time-dependent master data, dimensional models, and star schemas.
- Develop, orchestrate, and monitor data pipelines using Cloud Composer / Apache Airflow, including automated alerting for pipeline and load failures.
- Implement data security within BigQuery including row-level security (RLS), column-level security (CLS), authorized views, role-based access, and PII masking.
- Optimize BigQuery workloads for performance and cost using partitioning, clustering, query optimization, and efficient data modelling.
- Build automated data-quality controls and reconciliation processes to validate migrated datasets against existing SAP BW reporting.
- Produce and maintain data lineage, transformation documentation, and source-to-target mappings.
- Prepare governed AI-ready datasets for conversational analytics, predictive use cases, and downstream AI applications.
- Support downstream reporting and analytics solutions developed using Looker or custom web applications.
- Work closely with business, Finance, HR, SAP, cloud, analytics, and reporting teams to validate business logic and data accuracy.
Required Experience & Technical Skills:
- 5+ years of professional data engineering experience, including at least 3 years of hands‑on Google BigQuery experience.
- Advanced SQL skills, particularly for complex data transformation and modelling in BigQuery.
- Strong Python skills for data engineering, automation, testing, and pipeline development.
- Hands‑on experience with dbt or Dataform.
- Strong experience with GCP data services including BigQuery, Cloud Storage, Cloud Composer, Dataflow, IAM, and VPC networking fundamentals.
- Proven experience integrating SAP S/4HANA, SAP ECC and/or SAP BW data with a cloud data platform.
- Strong understanding of dimensional modelling, star schemas, layered data architectures, hierarchies, and master data.
- Experience implementing BigQuery security including RLS, CLS, authorized views, IAM‑based access controls, and data masking.
- Experience with data‑quality frameworks, reconciliation, lineage, and source-to-target mapping.
- Ability to troubleshoot complex data pipelines and transformation logic across SAP and cloud environments.