Senior Databricks Data Engineer – Lakehouse Specialist

Steampunk, Inc.; McLean (VA); On-site; USD 140,000 - 180,000; Full time

Job summary

Steampunk is seeking a seasoned Senior Data Engineer to architect and implement enterprise-grade data platforms, lakes, and lakehouses using Databricks. You will collaborate with clients to design scalable pipelines and optimize data workflows across cloud environments (AWS, Azure, GCP) and modern data tools.

You should bring 5–7 years of data engineering experience, strong SQL skills, and hands-on mastery of Databricks, Spark, and orchestration tools.

Qualifications

• U.S. government security clearance ability is required.
• Bachelor's degree in a related technical discipline.
• 5–7 years of industry experience with production software and data engineering.
• Strong experience with Databricks, Spark, Delta Lake, and data pipelines.
• Experience with SQL and relational databases; performance optimization.
• Experience with modern cloud platforms (AWS, Azure, GCP) and data lakehouse architectures.
• Experience with SDLC, CI/CD, and Agile environments.

Responsibilities

• Lead design, development, and migration of data lakes and lakehouses with Databricks.
• Assess ETL jobs, data marts, BI reports and data dependencies.
• Develop scalable data pipelines and processing on Databricks.
• Address questions on customization, enterprise architecture and data products.
• Build and support data warehouse, data lake, and lakehouse solutions in cloud environments.
• Apply Databricks, SQL, PySpark/Python and cloud tech to data engineering tasks.
• Support Agile software development lifecycle.
• Contribute to AI & Data Exploitation Practice growth.

Skills

Databricks

SQL

PySpark/Python

Java

Scala

Cloud platforms (AWS/Azure/GCP)

Data governance & SDLC

Agile

Data modeling & ETL design

Communication / customer service

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or related technical discipline

Tools

Databricks

Apache Spark

Delta Lake

Airflow

AWS

Azure

GCP

Python

Java

C++

Shell/Scripting

Job description

Steampunk is seeking a seasoned Senior Data Engineer to architect and implement enterprise-grade data platforms, lakes, and lakehouses using Databricks. You will collaborate with clients to design scalable pipelines and optimize data workflows across cloud environments (AWS, Azure, GCP) and modern data tools.

You should bring 5–7 years of data engineering experience, strong SQL skills, and hands-on mastery of Databricks, Spark, and orchestration tools.