Lead Data Architect - Databricks on Azure (Remote)

CyberCoders, Inc.; United States; Remote; USD 150,000 - 190,000; Full time

Benefits offered by this job

Medical

Dental

Vision

401k w/ match

Remote

PTO

Job summary

CyberCoders, Inc. is seeking a Lead Data Architect with deep Databricks and Azure expertise to design and govern an enterprise-scale data platform.

You will lead architecture and delivery for analytics, ML and reporting, shaping data models, ingestion strategies, and data contracts while partnering with engineering and product teams. The role emphasizes strong SQL, hands-on Databricks and Azure experience, with healthcare data privacy familiarity as a plus.

Qualifications

• Proven experience leading data architecture/engineering in enterprise environments.
• Strong hands-on Databricks (Spark), Delta Lake and Databricks best practices.
• Deep Azure platform knowledge (ADLS, Azure Databricks, Azure SQL, ADF) and cloud security patterns.
• Expert SQL for data modeling and analytics.
• Experience designing ingestion pipelines and ETL/ELT (batch and streaming).
• Proficiency in Python for data engineering tasks.
• Experience with platform rationalization and reducing technical debt.
• Healthcare data privacy/compliance familiarity considered a plus.

Responsibilities

• Lead end-to-end design and delivery of a Databricks-based data platform on Azure, including architecture and best practices.
• Define and maintain data models, schemas, and data contracts to support analytics, ML and reporting.
• Architect and oversee ingestion pipelines and ETL/ELT workflows (batch and streaming).
• Collaborate with engineering, product and business teams to translate requirements into reusable data products and APIs.
• Establish and enforce data governance, security, access controls and HIPAA compliance where applicable.
• Optimize performance and cost across Databricks, storage and SQL workloads; tune Spark jobs and cluster config.
• Drive platform rationalization and delivery: evaluate tooling and standardize patterns across projects.
• Mentor and lead engineers; run architecture reviews and onboarding.
• Implement CI/CD, automated testing, monitoring, observability and runbooks for data processes.
• Document architecture, SLAs and data lineage; communicate designs to stakeholders.

Skills

Databricks

Azure

SQL

Python

Data modeling

ETL/ELT

Data governance

HIPAA knowledge

Mentorship

Education

Bachelor's degree in Computer Science, Engineering, Information Systems or equivalent

Tools

Delta Lake

ADLS

Azure Data Factory

Job description

CyberCoders, Inc. is seeking a Lead Data Architect with deep Databricks and Azure expertise to design and govern an enterprise-scale data platform.

You will lead architecture and delivery for analytics, ML and reporting, shaping data models, ingestion strategies, and data contracts while partnering with engineering and product teams. The role emphasizes strong SQL, hands-on Databricks and Azure experience, with healthcare data privacy familiarity as a plus.