Databricks Architect (Lead Data Platform Architect)

iLink Digital

New York (NY)

In loco

USD 180.000 - 240.000

Tempo pieno

14 giorni+

Una candidatura completa in un minuto

Curriculum e lettera di presentazione personalizzati, pronti da inviare.

Supera i filtri ATS

Descrizione del lavoro

iLink Digital is seeking a Databricks Architect (Lead Data Platform Architect) in New York, NY to design, build, and scale enterprise-grade Lakehouse data platforms. You will lead architecture strategy, platform standardization, and modernization initiatives leveraging Databricks across cloud ecosystems.

The ideal candidate brings deep expertise in Spark, Delta Lake, and cloud-native architecture, with proven leadership in large-scale data transformations.

Competenze

  • 12+ years in data engineering, architecture, or platform design.
  • Strong leadership with proven enterprise data platform delivery.
  • Deep expertise in Spark, Delta Lake, and cloud-native architectures.

Mansioni

  • Define end-to-end Databricks Lakehouse architecture.
  • Design scalable batch and real-time data processing systems.
  • Lead deployment across Azure/AWS/GCP Databricks environments.
  • Establish standards for workspace design, cluster strategy, and data storage.
  • Drive governance, security, and data privacy compliance.
  • Mentor data engineers, scientists, and TPMs on best practices.

Conoscenze

Leadership
Architecture design
Cloud architecture
Databricks
Spark/PySpark optimization
Data lakehouse

Formazione

Bachelor's degree in CS/Engineering or equivalent

Strumenti

Databricks
Delta Lake
Azure/AWS/GCP Databricks
Unity Catalog

Descrizione del lavoro

Databricks Architect (Lead Data Platform Architect)

New York, United States | Posted on 06/25/2026

We are looking for a highly skilled Databricks Architect to design, build, and scale enterprise-grade Lakehouse data platforms. This role will drive architecture strategy, platform standardization, and enterprise data modernization initiatives, leveraging Databricks and cloud ecosystems.

The ideal candidate brings deep expertise in Spark, Delta Lake, and cloud-native architecture, along with strong leadership in driving large-scale data transformations.

Key Responsibilities
  • Define and implement end-to-end Databricks Lakehouse architecture.
  • Design scalable systems for:
    • Batch & real-time data processing
    • Structured & unstructured workloads
  • Establish medallion architecture (Bronze, Silver, Gold layers) as a standard.
  • Lead deployment and optimization of:
    • Azure Databricks / AWS Databricks / GCP Databricks
  • Define standards for:
    • Workspace design & cluster strategy
    • Job orchestration
    • Data storage (Delta Lake)
  • Drive adoption of:
    • Unity Catalog
    • MLflow
    • Databricks SQL & Photon
  • Batch (ADF, Airflow)
  • Data modeling (star schema, data vault, dimensional models)
  • Guide engineering teams on best practices in Spark/PySpark optimization.
Performance & Cost Optimization
  • Query performance
  • Implement cost governance strategies (auto-scaling, job clusters, spot instances).
Data Governance & Security
  • Fine-grained access control (RBAC/ABAC)
  • Ensure compliance with data privacy and regulatory standards.
  • Integrate Databricks with:
    • Data sources (ERP, CRM, APIs, IoT)
    • BI tools (Power BI, Tableau)
    • ML pipelines and AI platforms
  • Collaborate with cloud architects for:
    • Networking, security, and storage strategies.
  • Provide architectural guidance to data engineers, scientists, and TPMs.
  • Conduct design reviews and enforce architecture governance.
  • Mentor teams on emerging patterns:
    • Data Mesh
    • DataOps / MLOps
    • GenAI workloads on Databricks
Skills & Qualifications
Mandatory Skills
  • 12+ years of experience in data engineering, architecture, or platform design.
Ottieni la revisione del curriculum gratis e riservata.

o trascina qui il file.

Similar jobs

Offerte di lavoro simili che vale la pena confrontare

Lead Databricks Lakehouse Architect
Lead Databricks Lakehouse Architect

Compunnel Inc. • Florida

In loco
USD 120.000 - 160.000
Databricks Solutions Architect
Databricks Solutions Architect

Compunnel Inc. • Florida

In loco
USD 120.000 - 160.000
Databricks Architect - Lakehouse Modernization
Databricks Architect - Lakehouse Modernization

Anblicks Inc. • Dallas (TX)

In loco
USD 150.000 - 190.000
Lead Databricks Data Engineer
Lead Databricks Data Engineer

Fa Ewjt Saasfaprod1 • New York (NY)

In loco
USD 140.000 - 170.000
Databricks Architect
Databricks Architect

Connect Tech+Talent • Stati Uniti

In loco
USD 150.000 - 210.000
Databricks Architect
Databricks Architect

Applexus Technologies (P) Ltd • Federal Way (WA)

In loco
USD 150.000 - 200.000
Databricks Solution Architect
Databricks Solution Architect

Tata Consultancy Services Limited • Irving (TX)

In loco
USD 125.000 - 140.000
Databricks Lakehouse Architect — Hybrid Data Platform
Databricks Lakehouse Architect — Hybrid Data Platform

Persistent Systems • Village of Tarrytown (NY)

Ibrido
USD 180.000 - 230.000
Hybrid work model
Flexible hours
Assistive technologies
+1
Databricks Data Architect/Lead
Databricks Data Architect/Lead

Celebal Technologies • Stati Uniti

In loco
USD 180.000 - 240.000
Databricks Data Architect
Databricks Data Architect

Winfo Solutions • Atlanta (GA)

In loco
USD 140.000 - 210.000