Remote Senior Databricks Architect for Azure Lakehouse

EUROPEAN DYNAMICS Group; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

EUROPEAN DYNAMICS seeks a Senior Databricks Administrator/Architect fluent in English for remote engagement. You will join the Development team and collaborate with a major client's IT team to design and implement scalable data platforms on Azure Databricks, Delta Lake, and Unity Catalog.

The role requires deep expertise in data engineering, security, governance, and cloud infrastructure, with strong Python/PySpark skills. Remote work with international collaboration is expected.

Qualifications

• Bachelor's degree in IT or related field and 9+ years of IT experience.
• 8+ years designing enterprise data platforms with Azure Databricks.
• 5+ years hands-on Azure Databricks in enterprise environments.
• Experience with Lakehouse, Delta Lake, Unity Catalog and governance.
• CI/CD with Azure DevOps, Terraform/Bicep, deployment automation.
• Strong security architecture knowledge: RBAC, PIM, encryption, Key Vault.
• Proficiency in SQL, Python and PySpark; familiarity with BI/analytics tools.
• English fluent; experience in international organizations is a plus.

Responsibilities

• Architect and implement scalable enterprise data platform solutions using Azure Databricks and related Azure services.
• Design data engineering frameworks for batch, streaming, ELT/ETL, and real‑time analytics.
• Administer Databricks workspaces, Unity Catalog, secrets, and governance policies.
• Define security with Entra ID, RBAC, PIM, encryption, private networking, and Key Vault.
• Establish data governance: lineage, quality, metadata, catalog, access policies, audits.
• Deploy CI/CD pipelines with Azure DevOps and DAB; use Terraform/Bicep for IaC.
• Tune Spark workloads, optimize clusters, caching, partitioning, and Photon usage.
• Create monitoring dashboards with Azure Monitor and Log Analytics; incident support.
• Develop architecture patterns, standards, naming conventions, and documentation.
• Assist migration from legacy warehouses to Databricks Lakehouse.
• Provide technical support for production incidents related to Databricks and data pipelines.

Skills

Azure Databricks

Delta Lake

Unity Catalog

Azure Data Factory

Python / PySpark

Azure AD / RBAC

Terraform / IaC

CI/CD pipelines

Azure Monitor / Log Analytics

Education

University degree in IT or related field

Tools

Terraform

Databricks

Azure Key Vault

Azure Monitor

Job description

EUROPEAN DYNAMICS seeks a Senior Databricks Administrator/Architect fluent in English for remote engagement. You will join the Development team and collaborate with a major client's IT team to design and implement scalable data platforms on Azure Databricks, Delta Lake, and Unity Catalog.

The role requires deep expertise in data engineering, security, governance, and cloud infrastructure, with strong Python/PySpark skills. Remote work with international collaboration is expected.