Databricks Architect

Q1 Technologies, Inc.; Malvern (Chester County); On-site; USD 140,000 - 190,000; Full time

Job summary

Q1 Technologies, Inc. in Malvern, PA is seeking a Senior Databricks Architect with 14+ years of experience to design and implement enterprise-scale Lakehouse architectures on cloud platforms.

You will lead data strategy, governance, and scalable analytics platforms supporting AI/ML and BI initiatives. The role focuses on Databricks, Spark, PySpark, Delta Lake, and real-time data processing, with strong emphasis on security, governance, and cloud migration strategy.

Qualifications

• Experience with dimensional modeling (star/snowflake) and data warehouse design.
• Proven data lake architecture experience (S3, Lake Formation, best practices).
• Big data processing with Spark/PySpark; EMR familiarity is a plus.
• Advanced SQL skills, query tuning and performance optimization.
• Experience with real-time streaming (Kinesis and/or Kafka).
• Security & governance skills (IAM, KMS, encryption, governance).
• Infrastructure as Code using Terraform and/or CloudFormation.
• Ability to design solutions and translate business requirements into data architectures.
• Leadership experience guiding cross-functional teams on cloud migrations.

Responsibilities

• Design and implement enterprise-scale Lakehouse architectures on cloud platforms (Databricks, Spark).
• Define data strategy, architecture standards, governance, and scalable analytics platforms for AI/ML and BI initiatives.
• Lead stakeholder discussions, translate requirements, and drive delivery of data engineering projects.

Skills

Data Modeling

Data Warehouse

Data Lake Architecture

Spark PySpark

SQL Optimization

Streaming Real-Time

Security & Governance

IaC Terraform/CF

Architecture Leadership

Job description

Location: Malvern PA (Onsite From Day 1/Hybrid)

Job Description:

Databricks Architect- 14+ years

Senior Databricks Architect with strong experience in designing and implementing enterprise-scale Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing.

Databricks Architect, Databricks Lakehouse, Apache Spark, PySpark, Delta Lake, Unity Catalog, Structured Streaming, Kafka, Data Modeling, ETL, ELT, AWS, S3, Redshift, Glue, Airflow, Terraform, CI/CD, Data Governance, Lakehouse Architecture, Performance Tuning

Must Have Technical/Functional Skills

• Data Modeling – Dimensional Modeling (Star/Snowflake), Data Warehouse Design.
• Data Lake Architecture – Amazon S3, Lake Formation, Data Lake best practices.
• Big Data & Processing – Spark/PySpark, Amazon EMR.
• SQL Expertise – Advanced SQL, query optimization, performance tuning.
• Streaming & Real-Time Data – Kinesis and/or Kafka
• Security & Governance – IAM, KMS, Lake Formation, Encryption, Data Governance.
• Infrastructure as Code – Terraform and/or CloudFormation.
• Architecture & Stakeholder Management – Solution design, cloud migration, business requirement translation.

Senior Databricks Architect with strong experience in designing and implementing enterprise-scale

Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing. Responsible for defining data strategy, architecture standards, governance, and scalable analytics platforms supporting AI/ML and business intelligence initiatives

Generic Managerial Skills, If any

• Strong leadership and stakeholder management skills, with experience leading cross-functional teams and driving delivery excellence.
• Proven effective communication with business and technical stakeholders.