Senior Databricks Architect Remote Data Platform Leader

metaphaseconsulting; United States; Remote; USD 150,000 - 230,000; Full time

Benefits offered by this job

Generous PTO

Health insurance

401(k) with company match

Job summary

MetaPhase is seeking a Principal Databricks Architect/Engineer to provide technical leadership for a Databricks-based data and analytics environment. You will translate business needs into secure, scalable data solutions, set technical standards, and guide engineers in implementing best practices aligned with governance and security policies.

Responsibilities include defining the architecture roadmap, designing lakehouse patterns, establishing CI/CD, and driving data governance across the

Qualifications

• Bachelor’s degree in a technical discipline
• 8+ years designing, building, and operating cloud data platforms
• 5+ years hands-on data engineering with Python, SQL, Spark
• 3+ years Databricks architecture and engineering experience
• Databricks Certified Data Engineer Professional certification required
• Ability to lead technical architecture and governance standards
• US Public Trust suitability and US Citizenship required

Responsibilities

• Define target architecture and technical roadmap for the Databricks platform
• Design scalable Lakehouse architectures using Delta Lake, Unity Catalog, and Spark
• Maintain platform standards for data modeling, CI/CD, testing, and observability
• Lead data governance, cataloging, access controls, lineage, and data quality processes
• Architect secure integrations between Databricks and source systems and cloud services
• Provide hands-on support for complex data pipelines, tuning, and releases
• Review designs and mentor engineers to share reusable patterns
• Support architecture reviews and continuous improvement activities

Skills

Python

SQL

Apache Spark

Databricks

Data governance

Leadership

Cloud data platforms

Education

BA/BS in technical discipline

Tools

Delta Lake

Unity Catalog

Databricks SQL

Airflow

Job description

MetaPhase is seeking a Principal Databricks Architect/Engineer to provide technical leadership for a Databricks-based data and analytics environment. You will translate business needs into secure, scalable data solutions, set technical standards, and guide engineers in implementing best practices aligned with governance and security policies.

Responsibilities include defining the architecture roadmap, designing lakehouse patterns, establishing CI/CD, and driving data governance across the