Databricks Lakehouse Architect - Cloud Data Platform Lead

Themesoft Inc; Bolingbrook (IL); On-site; USD 140,000 - 190,000; Full time

Job summary

The Databricks Architect at Themesoft Inc will design, implement, and govern enterprise-scale data platforms on Databricks, focusing on data architecture, cloud integration, analytics enablement, and platform optimization across Azure, AWS, or GCP.

You will lead migration of legacy data warehouses, define enterprise data models and security controls, and provide technical leadership to data engineers, data scientists, and cloud architects.

Qualifications

• 8+ years of data engineering and data platform experience.
• 3+ years of hands-on Databricks architecture experience.
• Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake.
• Experience with Azure Databricks, AWS Databricks, or GCP Databricks.
• Strong expertise in streaming platforms: GCP Pub/Sub, Azure Event Hubs, AWS Kinesis, Apache Kafka.

Responsibilities

• Design and implement scalable data Lakehouse architectures using Databricks.
• Define enterprise data models, governance standards, and security controls.
• Lead migration of legacy data warehouses and ETL workloads to Databricks.
• Architect batch and real-time data processing solutions using Spark.
• Optimize performance, scalability, reliability, and cost efficiency.
• Collaborate with business stakeholders, data engineers, data scientists, and cloud architects.
• Establish CI/CD, monitoring, and operational best practices for data platforms.
• Provide technical leadership and mentor engineering teams.

Skills

Databricks architecture

Apache Spark

PySpark

SQL

Delta Lake

Data governance

Cloud platforms (Azure/AWS/GCP)

Streaming data

Data modeling

CI/CD for data platforms

Education

Bachelor's degree in CS/Engineering/IS

Master's degree preferred

Tools

Databricks

Unity Catalog

Delta Live Tables

Databricks Workflows

Job description

The Databricks Architect at Themesoft Inc will design, implement, and govern enterprise-scale data platforms on Databricks, focusing on data architecture, cloud integration, analytics enablement, and platform optimization across Azure, AWS, or GCP.

You will lead migration of legacy data warehouses, define enterprise data models and security controls, and provide technical leadership to data engineers, data scientists, and cloud architects.