Databricks Architect

SIMARN Solutions

Bolingbrook (IL)

On-site

USD 130,000 - 190,000

Full time

5 hours ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

SIMARN Solutions is seeking an experienced Databricks Architect to design and lead enterprise-scale data platforms and lakehouse solutions. You will focus on Databricks architecture, cloud data engineering, streaming, governance, migration, and platform optimization across Azure, AWS, or GCP.

You will design scalable lakehouse architectures, lead migrations from legacy warehouses, and implement real-time data pipelines with Spark, while defining security, access controls, and DataOps practices

Qualifications

8+ years of data engineering and data platform experience.
3+ years of hands-on Databricks architecture experience.
Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake.
Experience with Azure/AWS/GCP Databricks.
Strong streaming experience with Kafka, Event Hubs, Kinesis, or Pub/Sub.
Hands-on understanding of producer/consumer architectures and design trade-offs.
Experience with lakehouse architecture, data governance, orchestration, security, and access management.

Responsibilities

Design scalable Databricks Lakehouse architectures and enterprise data solutions.
Lead migrations of legacy data warehouses and ETL workloads to Databricks.
Architect batch and real-time/streaming pipelines using Spark.
Define data governance, security, access controls, and enterprise data standards.
Drive platform performance, scalability, reliability, and cost optimization.
Establish CI/CD, monitoring, DataOps, and operational best practices.
Partner with data engineers, data scientists, cloud architects, and business stakeholders.
Provide architectural guidance and technical leadership to engineering teams.

Skills

8+ years data engineering

3+ years Databricks architecture

Apache Spark

PySpark

SQL

Delta Lake

Azure Databricks

AWS Databricks

GCP Databricks

Kafka

Azure Event Hubs

AWS Kinesis

GCP Pub/Sub

Producer/consumer architectures

Lakehouse architecture

Data governance

Security and access management

Orchestration

Unity Catalog

Delta Live Tables

Databricks Workflows

Power BI

Tableau

DataOps/DevOps

Education

Bachelor's degree in CS/Engineering/IS

Tools

Unity Catalog

Delta Live Tables

Databricks Workflows

Power BI

Tableau

Job description

We are looking for an experienced Databricks Architect to design and lead enterprise-scale data platforms and lakehouse solutions. This role will focus on Databricks architecture, cloud data engineering, streaming, governance, migration, and platform optimization across Azure, AWS, or GCP.

What You’ll Do

Design scalable Databricks Lakehouse architectures and enterprise data solutions.
Lead migrations of legacy data warehouses and ETL workloads to Databricks.
Architect batch and real-time/streaming pipelines using Spark.
Define data governance, security, access controls, and enterprise data standards.
Drive platform performance, scalability, reliability, and cost optimization.
Establish CI/CD, monitoring, DataOps, and operational best practices.
Partner with data engineers, data scientists, cloud architects, and business stakeholders.
Provide architectural guidance and technical leadership to engineering teams.

Must-Have Skills

8+ years of data engineering/data platform experience.
3+ years of hands-on Databricks architecture experience.
Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake.
Experience with Azure Databricks, AWS Databricks, or GCP Databricks.
Strong streaming experience with Kafka, Azure Event Hubs, AWS Kinesis, or GCP Pub/Sub.
Hands-on understanding of producer/consumer architectures and design trade-offs.
Experience with lakehouse architecture, data governance, orchestration, security, and access management.

Nice to Have