Lead Databricks Lakehouse Architect

iLink Digital; New York (NY); On-site; USD 170,000 - 250,000; Full time

Job summary

iLink Digital seeks a Databricks Architect to design, build, and scale enterprise Lakehouse data platforms in a leading data-driven environment. You will drive architecture strategy, define standards, and mentor cross-functional teams across cloud platforms to deliver secure, scalable data solutions with governance and performance optimizations.

Lead the deployment and optimization across Azure, AWS, and GCP Databricks, shaping data governance, security, and data modeling practices for complex

Qualifications

• 12+ years of experience in data engineering, architecture, or platform design.
• Deep expertise in Spark, Delta Lake, and cloud-native architecture.
• Strong leadership in driving large-scale data transformations.

Responsibilities

• Define and implement end-to-end Databricks Lakehouse architecture.
• Design scalable systems for batch & real-time data processing; structured & unstructured workloads.
• Establish medallion architecture (Bronze, Silver, Gold) as a standard.
• Lead deployment and optimization of Azure Databricks / AWS Databricks / GCP Databricks.
• Define standards for workspace design, cluster strategy, job orchestration, and Delta Lake storage.
• Drive adoption of Unity Catalog, MLflow, Databricks SQL & Photon.
• Batch (ADF, Airflow) and data modeling (star schema, data vault).
• Guide engineering teams on Spark/PySpark optimization.

Skills

Databricks architecture

Spark/PySpark optimization

Delta Lake

Cloud Databricks (Azure/AWS/GCP)

Data governance

Data modeling

Leadership

Data engineering

ETL design

MLOps/DataOps

GenAI workloads

Tools

Unity Catalog

MLflow

Databricks SQL

Photon

Airflow

ADF

Power BI

Tableau

Job description

iLink Digital seeks a Databricks Architect to design, build, and scale enterprise Lakehouse data platforms in a leading data-driven environment. You will drive architecture strategy, define standards, and mentor cross-functional teams across cloud platforms to deliver secure, scalable data solutions with governance and performance optimizations.

Lead the deployment and optimization across Azure, AWS, and GCP Databricks, shaping data governance, security, and data modeling practices for complex