Databricks Lakehouse Architect & Lead Data Engineer (AWS)

ELLIOTT MOSS CONSULTING PTE. LTD.; Dublin; On-site; EUR 140,000 - 210,000; Full time

Job summary

Elliott Moss Consulting Pte. Ltd. is seeking an experienced Databricks Architect / Lead Data Engineer to design, develop, and deliver enterprise-scale data platforms on Databricks and AWS.

The role combines architecture leadership with hands-on engineering responsibilities across modern data pipelines, AI/ML workloads, and governance. Responsibilities include leading Databricks initiatives, mentoring engineers, building scalable pipelines, and optimizing Spark workloads while driving CI/CD,

Qualifications

• Extensive experience designing Databricks Lakehouse architectures on AWS.
• Proven ability to lead data engineering teams and deliver scalable pipelines.
• Strong knowledge of governance, Unity Catalog, and security controls.

Responsibilities

• Design and own Databricks Lakehouse architecture on AWS and guide engineers.
• Build and optimize batch and streaming data pipelines using PySpark and SQL.
• Implement Medallion architecture (Bronze/Silver/Gold) across enterprise datasets.
• Enable AI/ML workloads on Databricks and integrate with AWS services.

Skills

Databricks Lakehouse

PySpark

Python

SQL

Delta Lake

Unity Catalog

RBAC

CI/CD

AWS

Tools

Databricks

AWS

S3

Job description

Elliott Moss Consulting Pte. Ltd. is seeking an experienced Databricks Architect / Lead Data Engineer to design, develop, and deliver enterprise-scale data platforms on Databricks and AWS.

The role combines architecture leadership with hands-on engineering responsibilities across modern data pipelines, AI/ML workloads, and governance. Responsibilities include leading Databricks initiatives, mentoring engineers, building scalable pipelines, and optimizing Spark workloads while driving CI/CD,