Databricks Engineer/Architect — Managing Consultant

Thought Logic Consulting; Birmingham (AL); On-site; USD 140,000 - 190,000; Full time

Job summary

Thought Logic Consulting is seeking a Databricks Engineer/Architect in Birmingham, AL with 7+ years of data engineering experience and hands-on Databricks expertise. The role focuses on building scalable data solutions, modern data platforms, and delivering data-driven client outcomes.

You will design data pipelines, manage governance and quality, and contribute to DevOps practices while collaborating with senior consultants and clients.

Qualifications

• 7+ years of data engineering/architecture experience.
• At least 2 years of hands-on Databricks experience.
• Experience with Lakehouse technologies and modern data platforms.
• Strong consulting, communication, and problem-solving skills.

Responsibilities

• Design and build scalable data engineering solutions using Databricks Lakehouse, Delta Lake, Unity Catalog, Delta Live Tables, Delta Sharing, and Iceberg where appropriate.
• Develop and optimize batch, micro-batch, and streaming data pipelines using Spark, PySpark, SQL, and Python.
• Build ETL/ELT processes, data models, and orchestration using Databricks Workflows/Jobs, Airflow, dbt, and modern patterns.
• Implement data quality, observability, governance, auditability, and performance optimization across data platforms.
• Establish CI/CD and DevOps practices for data engineering with Terraform and related tooling.

Skills

Databricks

Delta Lake

Unity Catalog

Lakehouse architecture

Apache Spark

PySpark

SQL

Python

Data pipelines

CI/CD

Terraform

Airflow

dbt

Tools

Databricks Workflows/Jobs

Auto Loader

Airflow

dbt

Terraform

Snowflake

Redshift

BigQuery

Kubernetes

Job description

Thought Logic Consulting is seeking a Databricks Engineer/Architect in Birmingham, AL with 7+ years of data engineering experience and hands-on Databricks expertise. The role focuses on building scalable data solutions, modern data platforms, and delivering data-driven client outcomes.

You will design data pipelines, manage governance and quality, and contribute to DevOps practices while collaborating with senior consultants and clients.