Senior Databricks Architect: End-to-End Data Platform Leader

Visa Hunt; Singapore; On-site; SGD 180,000 - 280,000; Full time

Job summary

Avensys Consulting Pte Ltd in Singapore is seeking a Senior Solution Architect for Databricks to lead end-to-end data platform engagements across industries. You will design scalable data architectures, oversee Databricks PS collaborations, and deliver robust data ingestion and processing pipelines.

The role requires 8–10 years in data architecture/engineering, hands-on Databricks experience, Unity Catalog, Delta Lake, and Spark.

Qualifications

• Extensive hands-on Databricks experience with workspace and cluster management.
• Unity Catalog implementation experience for unified governance and access control.
• Strong data modelling skills including dimensional modelling and lakehouse architectures.
• Delta Lake knowledge including ACID, time travel, optimizations.
• Proficiency in Spark SQL, DataFrames, and performance tuning.
• Programming skills in Python/SQL/Scala for data processing.
• Experience with cloud platforms (Azure, AWS, GCP).
• Experience with data pipelines and ETL/ELT processes.
• Knowledge of data governance frameworks and metadata management.
• CI/CD practices for data platforms and data quality validation.
• Understanding of data security, privacy, and regulatory requirements.

Responsibilities

• Collaborate with Databricks PS and customers on end-to-end data architecture on Databricks platform.
• Design and implement data ingestion strategies from multiple source systems.
• Architect scalable storage using Delta Lake and lakehouse architectures.
• Develop efficient data processing using Apache Spark and Databricks workflows.
• Create data consumption layers for analytics, reporting and ML use cases.
• Ensure seamless data flow across the complete data lifecycle.

Skills

Databricks Platform

Unity Catalog

Data Modelling

Delta Lake

Apache Spark

Programming: Python/SQL/Scala

Cloud Platforms

Data Pipeline/ETL/ELT

Governance/Metadata

CI/CD for data platforms

Data quality & validation

Security & compliance

Job description

Avensys Consulting Pte Ltd in Singapore is seeking a Senior Solution Architect for Databricks to lead end-to-end data platform engagements across industries. You will design scalable data architectures, oversee Databricks PS collaborations, and deliver robust data ingestion and processing pipelines.

The role requires 8–10 years in data architecture/engineering, hands-on Databricks experience, Unity Catalog, Delta Lake, and Spark.