Principal Data Architect

REGTECH INSIGHT PTE. LTD.; Singapore; On-site; SGD 180,000 - 240,000; Full time

Job summary

REGTECH INSIGHT PTE. LTD. seeks a Principal Data Architect to lead the design and implementation of enterprise-scale cloud data and AI platforms, driving data architecture, Lakehouse platforms, AI/ML solutions, data governance, and technical strategy across complex enterprise environments.

You will drive Databricks Lakehouse implementations, build scalable ETL/ELT and data models, and shape governance, security and cost optimization while mentoring data engineers and scientists.

Qualifications

• 15+ years of experience in Data Architecture, Data Engineering, or Enterprise Architecture.
• Strong experience with Databricks, Azure/AWS, PySpark, Python, and SQL.
• Expertise in Lakehouse, Data Warehousing, ETL/ELT, and Data Modelling.
• Experience with AI/ML, GenAI, LLM, MLOps and MLflow.
• Knowledge of Data Governance, Data Quality, Security and Privacy.
• Experience with Kafka, CI/CD and DevOps.
• Certifications such as Databricks, DAMA-DMBOK, PMP, Power BI/Tableau/Qlik are a plus.

Responsibilities

• Design enterprise Data & AI architecture and cloud data platforms.
• Lead Databricks Lakehouse, Delta Lake, DLT and Unity Catalog implementations.
• Develop scalable ETL/ELT, data engineering and data modelling solutions.
• Design AI/ML, GenAI and MLOps platforms and production solutions.
• Implement data governance, quality, security, lineage and access controls.
• Lead cloud platforms across Azure and AWS.
• Design real-time data solutions using Kafka, Azure Event Hub and Spark Streaming.
• Drive CI/CD, DevOps and cloud cost optimization for data platforms.
• Provide technical leadership and mentoring to Data Engineers, ML Engineers and Data Scientists.
• Engage stakeholders to define technology roadmaps, solution architecture and delivery plans.

Skills

Databricks

Azure/AWS

PySpark

Python

SQL

Data Governance

Tools

Databricks Lakehouse

Delta Lake

DLT

Unity Catalog

Kafka

MLflow

CI/CD

Job description

Job Summary

We are seeking a Principal Data Architect to lead the design and implementation of enterprise-scale cloud data and AI platforms. The role will drive data architecture, Lakehouse platforms, AI/ML solutions, data governance, and technical strategy across complex enterprise environments.

Key Responsibilities

• Design enterprise Data & AI architecture and cloud data platforms.
• Lead Databricks Lakehouse, Delta Lake, DLT and Unity Catalog implementations.
• Develop scalable ETL/ELT, data engineering and data modelling solutions.
• Design AI/ML, GenAI and MLOps platforms and production solutions.
• Implement data governance, quality, security, lineage and access controls.
• Lead cloud platforms across Azure and AWS .
• Design real-time data solutions using Kafka, Azure Event Hub and Spark Streaming .
• Drive CI/CD, DevOps and cloud cost optimization for data platforms.
• Provide technical leadership and mentoring to Data Engineers, ML Engineers and Data Scientists.
• Engage stakeholders to define technology roadmaps, solution architecture and delivery plans.

Requirements

• 15+ years' experience in Data Architecture, Data Engineering or Enterprise Architecture.
• Strong experience with Databricks, Azure/AWS, PySpark, Python and SQL .
• Expertise in Lakehouse, Data Warehousing, ETL/ELT and Data Modelling .
• Experience with AI/ML, GenAI, LLM, MLOps and MLflow .
• Strong knowledge of Data Governance, Data Quality, Security and Privacy .
• Experience with Kafka/Azure Event Hub, CI/CD and DevOps .
• Strong technical leadership and stakeholder management skills.
• Preferred: Databricks certifications, DAMA-DMBOK, PMP, Power BI/Tableau/Qlik experience.