Databricks Architect

Prism IT Global; Malvern (Chester County); On-site; USD 180,000 - 260,000; Full time

Job summary

Prism IT Global is seeking a Senior Databricks Architect to design and implement enterprise-scale Lakehouse architectures on cloud platforms. You will define data strategy, governance, and scalable analytics capabilities to support AI/ML and BI initiatives.

You will lead cross-functional teams, translate business requirements into technical designs, and ensure delivery excellence across data pipelines, security, and compliance.

Qualifications

• Extensive experience with Databricks, Spark, and Delta Lake.
• Strong data modeling and dimensional modeling expertise.
• Proven ability to lead architecture governance and data strategy.
• Experience with real-time data streaming (Kinesis or Kafka) and data lake security.
• Hands-on IaC with Terraform or CloudFormation is preferred.
• Excellent stakeholder management and communication skills.

Responsibilities

• Define data strategy and architecture standards for enterprise data platforms.
• Design scalable Lakehouse architectures and analytics pipelines.
• Lead cross-functional teams and manage delivery of data projects.
• Collaborate with business and technical stakeholders to translate requirements.

Skills

Data modeling

Dimensional modeling

SQL proficiency

Real-time data processing

Stakeholder management

Tools

Databricks

Spark/PySpark

Delta Lake

Kinesis

Kafka

Amazon EMR

IAM

KMS

Terraform

CloudFormation

Amazon S3

Job description

• Data Modeling – Dimensional Modeling (Star/Snowflake), Data Warehouse Design.
• Data Lake Architecture – Amazon S3, Lake Formation, Data Lake best practices.
• Big Data & Processing – Spark/PySpark, Amazon EMR.
• SQL Expertise – Advanced SQL, query optimization, performance tuning.
• Streaming & Real-Time Data – Kinesis and/or Kafka
• Security & Governance – IAM, KMS, Lake Formation, Encryption, Data Governance.
• Infrastructure as Code – Terraform and/or CloudFormation.
• Architecture & Stakeholder Management – Solution design, cloud migration, business requirement translation.

Senior Databricks Architect with strong experience in designing and implementing enterprise-scale Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing. Responsible for defining data strategy, architecture standards, governance, and scalable analytics platforms supporting AI/ML and business intelligence initiatives

Generic Managerial Skills, If any

Strong leadership and stakeholder management skills, with experience leading cross-functional teams and driving delivery excellence.

Proven effective communication with business and technical stakeholders.