Senior Solution Architect - Databricks

idc technologies (singapore) pte. ltd.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

idc technologies (singapore) pte. ltd. is seeking an experienced Data Architect to lead end-to-end data architecture on the Databricks platform. You will design ingestion pipelines, build scalable Delta Lake storage, and craft medallion-style data models for analytics and ML use cases.

The role emphasizes governance, security, and collaboration with cross-functional teams to deliver enterprise-grade data solutions across the data lifecycle.

Qualifications

• Experience designing end-to-end data architectures on the Databricks platform.
• Ability to design scalable storage with Delta Lake and lakehouse patterns.
• Proven track record in governance, security, and regulatory compliance for data.
• Strong leadership and mentorship capabilities for technical teams.

Responsibilities

• Collaborate with Databricks PS and customers on end-to-end data architecture.
• Design and implement data ingestion strategies from multiple sources.
• Architect scalable storage using Delta Lake and lakehouse architecture.
• Develop data processing with Apache Spark and Databricks workflows.
• Create data consumption layers for analytics, reporting, and ML use cases.
• Ensure seamless data flow across the data lifecycle.

Skills

Databricks

Apache Spark

Delta Lake

Data modelling

Data governance

Security & compliance

Leadership

Mentoring

Cloud architecture

Tools

Databricks platform

Job description

End-to-End Data Architecture

• Collaborate with Databricks PS and customer on comprehensive end-to-end data architecture on Databricks platform
• Design and implement data ingestion strategies from various source systems
• Architect scalable storage solutions leveraging Delta Lake and lakehouse architecture
• Develop efficient data processing frameworks using Apache Spark and Databricks workflows
• Create data consumption layers for analytics, reporting, and machine learning use cases
• Ensure seamless data flow across the entire data lifecycle

Governance, Security & Compliance

• Collaborate with Databricks PS on implementing robust governance frameworks
• Design and enforce security policies and access controls within Databricks environments
• Ensure compliance with regulatory requirements and industry standards
• Implement data lineage, audit trails, and monitoring capabilities
• Optimize performance through best practices in cluster configuration and query optimization
• Establish data quality standards and validation processes

Data Modelling & Design

• Define business-aligned data models that support organizational objectives
• Design Delta table structures optimized for performance and scalability
• Create dimensional and normalized data models based on business requirements
• Implement medallion architecture (Bronze, Silver, Gold layers) for data refinement
• Develop data schemas that support both analytical and operational workloads
• Document data models and maintain data dictionaries

Technical Leadership & Collaboration

• Lead technical discussions with clients and stakeholders to understand business requirements
• Provide technical guidance to development teams on Databricks best practices
• Work closely with Infrastructure (Infra), Applications (Apps), and Cyber teams for integrated delivery
• Mentor junior architects and engineers on Databricks technologies
• Present solution architectures and technical recommendations to client leadership

Solution Implementation

• Oversee implementation of Databricks solutions from design through deployment
• Ensure solutions meet performance, scalability, and reliability requirements
• Support proof-of-concepts and pilot implementations
• Conduct architecture reviews and ensure alignment with enterprise standards