Unity Catalog Platform Architect - Databricks Leader

Infinitive Inc; McLean (VA); Presencial; USD 170.000 - 215.000; Jornada completa

Descripción de la vacante

Infinitive is a data & AI consultancy helping global brands leverage insights, innovation, and efficiency. We seek an architect to define a unified, scalable Databricks-based data platform with Unity Catalog as the governance core, enabling secure data access across multiple domains.

You will shape enterprise standards, drive adoption, and mentor teams on best practices. The role emphasizes designing a self-service layer, implementing metadata, RBAC/ABAC, and data masking to meet regulatory

Formación

• Bachelor’s or Master’s degree in CS/Engineering or related field.
• 8+ years in data architecture or platform engineering.
• Deep hands-on Databricks Unity Catalog governance and metadata management.
• Proficiency in Python (PySpark) and SQL; cloud platforms (AWS/Azure/GCP).
• Strong API engineering with REST/GraphQL/OpenAPI and security/observability.
• Expert-level data governance knowledge and regulatory compliance.
• Excellent communication and influence across executive, technical, and risk audiences.

Responsabilidades

• Define end-to-end architecture for a Databricks-based data platform at scale.
• Design a self-service platform layer using Unity Catalog for data discovery and access.
• Create patterns and references to drive enterprise reuse and standardization.
• Lead Unity Catalog governance: catalog hierarchies, access controls, and lineage.
• Implement metadata, RBAC/ABAC, and data masking for regulatory needs.
• Develop observability, FinOps, and cost-optimization for the platform.
• Architect REST/GraphQL APIs for governed data access and metadata integration.
• Guide Lakehouse-aligned data models and Spark/ETL/ELT pipelines with Unity Catalog.
• Collaborate with engineering, data science, and risk teams to align with business outcomes.
• Mentor engineers on Databricks and best practices; contribute to architecture groups.
• Promote easy adoption via design patterns and documentation.

Conocimientos

Databricks, Spark & Delta Lake

Unity Catalog

Python (PySpark)

SQL

Cloud platforms (AWS/Azure/GCP)

API design REST/GraphQL/OpenAPI

Data governance

Communication

Educación

Bachelor’s/Master’s in Computer Science or Engineering

Herramientas

Terraform/IaC

MLflow

Databricks Certified Data Engineer

AWS/Azure/GCP Architect certifications

Kafka / Structured Streaming

Descripción del empleo

Infinitive is a data & AI consultancy helping global brands leverage insights, innovation, and efficiency. We seek an architect to define a unified, scalable Databricks-based data platform with Unity Catalog as the governance core, enabling secure data access across multiple domains.

You will shape enterprise standards, drive adoption, and mentor teams on best practices. The role emphasizes designing a self-service layer, implementing metadata, RBAC/ABAC, and data masking to meet regulatory