Databricks Lakehouse Architect - Cloud Data & Streaming

SIMARN Solutions; Bolingbrook (IL); On-site; USD 130,000 - 190,000; Full time

Job summary

SIMARN Solutions is seeking an experienced Databricks Architect to design and lead enterprise-scale data platforms and lakehouse solutions. You will focus on Databricks architecture, cloud data engineering, streaming, governance, migration, and platform optimization across Azure, AWS, or GCP.

You will design scalable lakehouse architectures, lead migrations from legacy warehouses, and implement real-time data pipelines with Spark, while defining security, access controls, and DataOps practices

Qualifications

• 8+ years of data engineering and data platform experience.
• 3+ years of hands-on Databricks architecture experience.
• Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake.
• Experience with Azure/AWS/GCP Databricks.
• Strong streaming experience with Kafka, Event Hubs, Kinesis, or Pub/Sub.
• Hands-on understanding of producer/consumer architectures and design trade-offs.
• Experience with lakehouse architecture, data governance, orchestration, security, and access management.

Responsibilities

• Design scalable Databricks Lakehouse architectures and enterprise data solutions.
• Lead migrations of legacy data warehouses and ETL workloads to Databricks.
• Architect batch and real-time/streaming pipelines using Spark.
• Define data governance, security, access controls, and enterprise data standards.
• Drive platform performance, scalability, reliability, and cost optimization.
• Establish CI/CD, monitoring, DataOps, and operational best practices.
• Partner with data engineers, data scientists, cloud architects, and business stakeholders.
• Provide architectural guidance and technical leadership to engineering teams.

Skills

8+ years data engineering

3+ years Databricks architecture

Apache Spark

PySpark

SQL

Delta Lake

Azure Databricks

AWS Databricks

GCP Databricks

Kafka

Azure Event Hubs

AWS Kinesis

GCP Pub/Sub

Producer/consumer architectures

Lakehouse architecture

Data governance

Security and access management

Orchestration

Unity Catalog

Delta Live Tables

Databricks Workflows

Power BI

Tableau

DataOps/DevOps

Education

Bachelor's degree in CS/Engineering/IS

Tools

Unity Catalog

Delta Live Tables

Databricks Workflows

Power BI

Tableau

Job description

SIMARN Solutions is seeking an experienced Databricks Architect to design and lead enterprise-scale data platforms and lakehouse solutions. You will focus on Databricks architecture, cloud data engineering, streaming, governance, migration, and platform optimization across Azure, AWS, or GCP.

You will design scalable lakehouse architectures, lead migrations from legacy warehouses, and implement real-time data pipelines with Spark, while defining security, access controls, and DataOps practices