Remote Databricks Lakehouse Architect | Lead Data Platform

Cogniify; United States; Remote; USD 180,000 - 250,000; Full time

Benefits offered by this job

Unlimited PTO

Generous parental leave

Medical, dental, and vision coverage

Disability and life insurance

Mental health support

Employee Stock Purchase Plan (ESPP)

Yearly team-building experiences

Mentorship opportunities

Management resources and support

Small teams where your work makes a差

Job summary

Cogniify is seeking a seasoned Databricks Solutions Architect to design and lead data platforms across AWS, Azure, and Google Cloud. You will guide data storage, cleaning, protection, and usage, while steering teams from legacy warehouses to Databricks.

You will collaborate with data engineers, product managers, and business teams from design to live deployment, mentoring engineers and shaping governance, security, and CI/CD standards. Occasional travel for workshops is expected.

Qualifications

• Bachelor's/Master's degree in a related field or equivalent practical experience.
• 12+ years in data engineering or data architecture.
• 4+ years hands-on Databricks and Apache Spark experience using PySpark, Python and SQL.
• 3+ production Databricks implementations from design to go-live.
• Strong experience on at least one major cloud (AWS/Azure/GCP).
• Knowledge of Delta Lake, Unity Catalog, performance tuning and cluster sizing.
• Leadership and communication skills with stakeholders in large organizations.
• Experience setting CI/CD and DataOps standards (Git, automated testing).
• Willingness to travel for workshops and milestones.

Responsibilities

• Design lakehouse architectures on AWS, Azure, or GCP with medallion layers, Delta Lake and Unity Catalog.
• Set data pipelines using Lakeflow, Spark, PySpark and Databricks SQL.
• Define data governance, security, and FinOps controls.
• Lead migration from legacy warehouses to Databricks and ensure data parity with old systems.
• Establish CI/CD and DataOps standards including Git and automated testing.
• Mentor engineers and present designs to business leaders in clear terms.
• Travel for workshops and milestones as needed.

Skills

Databricks

Apache Spark

PySpark

Python

SQL

Education

BS/MS in CS/Engineering or related field

Tools

Lakeflow

Unity Catalog

Delta Lake

Terraform

Git

Databricks Asset Bundles

Job description

Cogniify is seeking a seasoned Databricks Solutions Architect to design and lead data platforms across AWS, Azure, and Google Cloud. You will guide data storage, cleaning, protection, and usage, while steering teams from legacy warehouses to Databricks.

You will collaborate with data engineers, product managers, and business teams from design to live deployment, mentoring engineers and shaping governance, security, and CI/CD standards. Occasional travel for workshops is expected.