Principal Databricks Architect

Jobvite, Inc.; Northern (KY); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Generous PTO

Federal holidays

Comprehensive health coverage

401(k) with company match

Commuter benefits

Job summary

MetaPhase is seeking a Principal Databricks Architect / Engineer to lead the architecture, design, and governance of a Databricks-based data platform. You will translate business needs into scalable, secure data solutions while setting engineering standards and guiding engineers.

The role requires hands-on Databricks experience, strong governance skills, and the ability to mentor a team. Remote work is supported with limited travel, focusing on reliability, performance, and cost efficiency.

Qualifications

• Bachelor’s degree in a technical discipline with 8+ years of progressive experience in cloud data platforms.
• 5+ years of hands-on data engineering using Python, SQL, Spark, and ETL/ELT pipelines in production.
• 3+ years of Databricks architecture and engineering with Delta Lake and Unity Catalog.
• Current Databricks Certified Data Engineer Professional certification.
• Ability to lead technical architecture and communicate decisions to stakeholders.

Responsibilities

• Lead the target architecture and roadmap for the Databricks platform across ingestion, storage, transformation, and analytics.
• Design scalable Lakehouse architectures using Delta Lake, Unity Catalog, and Spark.
• Define platform standards for data modeling, CI/CD, testing, and observability.
• Lead enterprise data governance including cataloging, access controls, lineage, and data quality.
• Architect secure integrations between Databricks and source systems, cloud services, and BI tools.
• Provide hands-on engineering support for complex data pipelines and performance tuning.
• Review designs and artifacts; mentor engineers and promote reusable patterns.
• Support architecture reviews and continuous improvement efforts.

Skills

Python

SQL

Apache Spark

Databricks

ETL/ELT pipelines

Data Governance

Education

BA/BS in a technical discipline

Tools

Delta Lake

Unity Catalog

Databricks SQL

CI/CD

Infrastructure as Code

Job description

At MetaPhase we believe Quirky is Cool and being authentic is the only way to be! We take the work we do very seriously and do a lot of important mission-focused work for our clients. We are individuals with different passions and strengths who take as much joy in the work we do as from those we work with. Today, we have a team that is invested in creating new solutions that lean forward, challenge the status quo, but also reflect our intimate knowledge of our customers’ business. Over the years we have fostered a culture in which we are united by shared values—passion, solidarity, generosity, curiosity, and boldness—and these come alive in the work we do and how we do it.

Together, we know our people are our difference—for our clients and our colleagues.

Are you ready to:

• Work alongside a dedicated and diverse set of people to offer honest advice and practical guidance to our clients?
• Learn and grow by taking advantage of every opportunity available to you?
• Join a company which prides itself on its shared values and inclusive culture?
• Be the difference and make it happen?

Role Summary

The Principal Databricks Architect / Engineer will provide technical leadership for the architecture, design, implementation, governance, and sustainment of a Databricks-based data and analytics environment. This role serves as the senior technical authority for the platform, translating mission and business needs into secure, scalable, maintainable, and cost-effective data solutions. The Principal Databricks Architect / Engineer will establish technical standards, advise and guide engineers through complex implementation decisions, and implement Databricks architectural best practices so the environment is operated in accordance with data governance, security, reliability, and performance requirements as well as agency IT and security policies.

What You Will Be Doing

• Lead the target architecture and technical roadmap for the Databricks platform, including data ingestion, storage, transformation, orchestration, analytics, sharing, and consumption patterns.
• Design and govern scalable Lakehouse architectures using Databricks capabilities such as Delta Lake, Unity Catalog, Databricks SQL, Lakeflow Jobs, Auto Loader, and Apache Spark
• Define and maintain platform standards for data modeling, medallion architecture, pipeline design, code quality, environment promotion, CI/CD, testing, documentation, observability, and incident response.
• Lead the design and implementation of enterprise data governance, including cataloging, access controls, data classification, lineage, auditability, retention, data quality, and stewardship processes.
• Architect secure integrations between Databricks and source systems, cloud services, enterprise applications, APIs, data warehouses, and reporting or visualization tools
• Provide technical leadership and hands-on engineering support for complex data pipelines, batch and streaming workloads, performance tuning, troubleshooting, and releases
• Review technical designs, code, and deployment artifacts; mentor engineers; and elevate team capability through reusable patterns, documentation, and knowledge transfer
• Support architecture reviews, technical demonstrations, operational reporting, backlog refinement, and continuous improvement activities.

What We Need From You (Required)

• Bachelor’s degree in a technical discipline and 8+ years of progressive experience designing, building, and operating cloud data, analytics, or enterprise data platforms.
• 5+ years of hands-on data engineering experience using Python, SQL, Apache Spark, and production ETL/ELT pipelines, including testing, deployment, monitoring, and troubleshooting.
• 3+ years of hands-on Databricks architecture and engineering experience, such as Delta Lake, Unity Catalog, workflow orchestration, performance tuning, and production support
• Current Databricks Certified Data Engineer Professional certification required.
• Demonstrated ability to lead technical architecture, establish engineering and governance standards, and communicate solution decisions to technical and nontechnical stakeholders
• Ability to obtain a U.S. Public Trust suitability determination
• U.S. Citizenship Required(Clearance / Citizenship Requirements)

Bonus Points (Desired)

• Experience implementing enterprise data governance and security controls, including role-based access, metadata, lineage, auditability, data-quality management, and sensitive-data protection.
• Experience with Databricks Asset Bundles, Databricks CLI or APIs, infrastructure-as-code, CI/CD, and automated environment promotion.
• Experience architecting data integrations across cloud services, enterprise systems, APIs, analytics platforms, and batch or streaming data sources.
• Relevant AWS, Azure, or Google Cloud architect or data-engineering certification; additional advanced Databricks certification is a plus.
• Experience supporting regulated, public-sector, or security-sensitive environments and leading technical teams using Agile methodologies.
• Additional Databricks certification s (e.g., Databricks Machine Learning Engineer Associate or Professional, Databricks Generative AI Engineer Associate)

Work Location

Remote (travel 5%)

Education

BA/BS in a Technical Discipline

Clearance Requirements

Must be able to obtain a U.S. Public Trust suitability determination. U.S. Citizenship Required.

Benefits & Perks

At MetaPhase, we care about your well-being and success. Our benefits include generous PTO, federal holidays, parental leave, comprehensive health coverage (medical, dental, vision, life, and disability), 401(k) with company match, FSA/HSA options, commuter benefits, and much more.

About MetaPhase

MetaPhase is different with a purpose — demonstrating a new approach to the industry that puts employees and culture first. We continue to be recognized by industry as one of the fastest-growing and most impactful consultancies in the nation. MetaPhase is an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, national origin, disability or veteran status, or any other factors protected

#LinkedIN