Databricks Data Engineer - AWS & Lakehouse Migrations

Steampunk, Inc.; McLean (VA); On-site; USD 110,000 - 160,000; Full time

Job summary

Steampunk, Inc. is seeking a seasoned Data Engineer to design enterprise-grade data platforms and pipelines in Databricks, collaborating with clients and teams to deliver scalable, reliable solutions.

You will drive migrations, optimize ETL workflows, and contribute to Steampunk's AI & Data Exploitation Practice, leveraging AWS, Spark, and Delta Lake while following Agile processes. Candidates should have 5+ years in data engineering and the ability to hold a position of public trust with the US

Qualifications

• Bachelor’s degree or equivalent with 5+ years of experience.
• 2-4 years coding commercial software.
• 2-4 years data engineering with Databricks/AWS.
• Ability to hold a position of public trust with the US government.

Responsibilities

• Lead migrations of data using Databricks with focus on performance, reliability, and scalability.
• Assess and understand ETL jobs, workflows, data marts, BI tools, and reports.
• Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products.
• Experience with cloud data platforms (AWS/Azure/GCP) and Databricks.
• Support an Agile software development lifecycle.
• Contribute to the growth of Steampunk's AI & Data Exploitation Practice.

Skills

Databricks

SQL

PySpark/Python

AWS

Apache Spark

Delta Lake

Airflow

CI/CD

Data Lakehouse

Education

Bachelor’s degree

5+ years experience

Tools

Databricks Workflows

Airflow

Step Functions

AWS S3

AWS EC2

AWS RDS

Informatica EDC

Unity Catalog

Collibra

Alation

Purview

DataZone

Job description

Steampunk, Inc. is seeking a seasoned Data Engineer to design enterprise-grade data platforms and pipelines in Databricks, collaborating with clients and teams to deliver scalable, reliable solutions.

You will drive migrations, optimize ETL workflows, and contribute to Steampunk's AI & Data Exploitation Practice, leveraging AWS, Spark, and Delta Lake while following Agile processes. Candidates should have 5+ years in data engineering and the ability to hold a position of public trust with the US