Databricks Architect

Centraprise, Corp.; Boynton Beach (FL); On-site; USD 130,000 - 180,000; Full time

Job summary

Centraprise Corp. in Boynton Beach, FL seeks a senior Data Engineer/Architect to design and scale enterprise analytics platforms using Databricks and AWS. You will lead data modeling, governance, and batch/streaming pipelines while aligning with business requirements.

You will drive architectural standards, mentor teams, and partner with stakeholders to deliver high-performance data solutions in a cloud-first environment.

Qualifications

• 10+ years of experience in data engineering and architecture.
• Hands-on with Databricks, PySpark, and Spark SQL.
• Expertise in Databricks Lakehouse, Delta Lake, Unity Catalog, Delta Live Tables, Databricks Workflows.
• Experience designing enterprise-scale analytics platforms.
• Strong governance, quality, and metadata management capabilities.
• Familiar with CI/CD, Git, Terraform, and IaC practices.

Skills

Data engineering

Data architecture

Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

Delta Live Tables

Databricks Workflows

Medallion Architecture

Batch processing

Streaming architectures

Data warehousing

ETL/ELT

Dimensional modeling

Relational modeling

Analytics data modeling

Data governance

Data quality

Metadata management

CI/CD practices

Git

Terraform

DevOps

Infrastructure as Code

AWS cloud

Architectural standards

Mentoring

Leadership

Platform modernization

Tools

Databricks Platform

Terraform

Git

Job description

• 10+ years of experience in Data Engineering and Data Architecture.
• 5+ years of hands-on experience with Databricks, PySpark, and Apache Spark.
• Strong expertise in - Databricks Lakehouse Architecture, Delta Lake, Unity Catalog, Delta Live Tables (DLT), Databricks Workflows, Medallion Architecture
• Experience designing enterprise-scale analytics and data platforms.
• Expert-level proficiency in PySpark and Spark SQL.
• Advanced SQL development and query optimization skills.
• Strong understanding of batch and streaming architectures.
• Experience with data warehousing, ETL/ELT, and large-scale data processing.
• Expertise in dimensional, relational, and analytical data modeling.
• Experience implementing data governance, data quality, and metadata management solutions.
• Knowledge of CI/CD practices, Git, DevOps, and Infrastructure as Code (Terraform preferred).
• Experience establishing architectural standards and engineering best practices.
• Architect and design scalable, secure, and high-performance data platforms using Databricks and AWS.
• Lead solution design, data modeling, and enterprise data architecture initiatives.
• Design and optimize batch and real-time data pipelines using Databricks, PySpark, and Delta Lake.
• Partner with business and technology stakeholders to define requirements and deliver strategic data solutions.
• Establish standards for data governance, security, quality, performance, and operational excellence.
• Provide technical leadership, mentoring, and architectural guidance to engineering teams.
• Drive cloud modernization, platform optimization, and data transformation initiatives.