Azure Databricks Architect for Enterprise Data & AI

Clearstead Advisors LLC; United States; Remoto; USD 180.000 - 240.000; Tempo pieno

Descrizione del lavoro

Clearstead Advisors is seeking an experienced Databricks Solution Architect to lead the design, development, and ongoing management of our enterprise data and AI platform. This role combines hands-on data engineering with strategic architecture leadership, collaborating with IT partners and stakeholders to advance our data capabilities.

The candidate will establish standards, build scalable data solutions, and ensure security, reliability, and performance of the Databricks environment while

Competenze

• Bachelor's degree in a data/IS/computer science related field or equivalent experience.
• Advanced degree preferred in information systems/data analytics.
• CDMP or Databricks certification preferred.
• 10+ years in data engineering/architecture roles.
• 4+ years designing and managing production Databricks environments.
• Expert knowledge of Azure Databricks, Unity Catalog, Delta Lake.

Mansioni

• Lead the architecture and development of the Azure Databricks platform with Delta Lake, Unity Catalog, and medallion architecture.
• Establish technical standards, security controls, and scalable data integration frameworks.
• Oversee platform performance, monitoring, and cost optimization.

Conoscenze

PySpark

SQL

Data pipelines

Azure Databricks

Security controls

CI/CD

Communication

Formazione

Bachelor's degree in Data, Information Systems, Computer Science, Business Analytics, or related field

Advanced degree in Information Systems, Data Analytics, or related discipline

Strumenti

Databricks

Azure

Terraform

CI/CD tools

Descrizione del lavoro

Clearstead Advisors is seeking an experienced Databricks Solution Architect to lead the design, development, and ongoing management of our enterprise data and AI platform. This role combines hands-on data engineering with strategic architecture leadership, collaborating with IT partners and stakeholders to advance our data capabilities.

The candidate will establish standards, build scalable data solutions, and ensure security, reliability, and performance of the Databricks environment while