Senior Data Engineer - Data Platform on Spark/Delta (Azure)

Renesas Electronics; Penang; On-site; MYR 120,000 - 180,000; Full time

Job summary

Renesas Electronics Malaysia is seeking a senior data platform engineer to design and build our governed enterprise data platform on Azure Databricks, Unity Catalog, and Delta Lake. You will work upstream with functional teams to shape how data is ingested, modelled, catalogued, and governed.

This role blends hands-on data engineering with architecture thinking, requiring SAP/manufacturing domain fluency, strong Spark/Delta Lake skills, and a passion for scalable, secure data assets.

Qualifications

• Strong Spark, Delta Lake, and distributed processing skills.
• Advanced SQL and Python.
• Hands-on Databricks / Unity Catalog experience.
• Solid ELT/ETL, data modelling, and orchestration background.
• Working knowledge of catalog / medallion design, PII, and data governance.
• Familiarity with SAP data (S/4HANA, Datasphere) and FI / CO / SD / MM / PP / GL domains.
• Understanding of manufacturing / supply-chain business flow.
• Experience with Oracle / SQL Server, CDC ingestion, and Git / Jira.
• Awareness of data privacy regulation (GDPR, APPI).

Responsibilities

• Design the data catalog with functional teams — domains, schemas, naming, and structure.
• Align ingestion strategy per source (CDC vs. file-based; Fivetran / SAP Datasphere / ADF).
• Model data to the platform's guiding principles and medallion flow (Landing → Bronze → Silver → Silver Final → Gold).
• Build scalable ELT/ETL pipelines on Spark and Delta Lake.
• Apply governance by design — Unity Catalog + Entra ID entitlements, group-based grants, standardization.
• Handle PII correctly — tag at the edge, classify (Class A/B), mask downstream via ABAC.
• Ensure data quality, performance, and security across pipelines.
• Drive CI/CD and DevOps practices for pipelines and catalog objects.
• Mentor junior engineers and contribute to design reviews and architectural decisions.

Skills

Spark

Delta Lake

SQL

Python

Databricks Unity Catalog

ELT/ETL

Data governance

PII handling

Manufacturing domain

Tools

Azure Databricks

Unity Catalog

Delta Lake

SAP Datasphere

Fivetran

ADF

Oracle/SQL Server

Job description

Renesas Electronics Malaysia is seeking a senior data platform engineer to design and build our governed enterprise data platform on Azure Databricks, Unity Catalog, and Delta Lake. You will work upstream with functional teams to shape how data is ingested, modelled, catalogued, and governed.

This role blends hands-on data engineering with architecture thinking, requiring SAP/manufacturing domain fluency, strong Spark/Delta Lake skills, and a passion for scalable, secure data assets.