Senior Databricks Data Engineer - AWS Architect

Steampunk; McLean (VA); Hybrid; USD 110,000 - 160,000; Full time

Job summary

Steampunk is seeking a seasoned Data Engineer to design and deliver enterprise-grade data platforms, services and pipelines using Databricks. The role requires strong communication skills and a passion for data and problem solving.

You will lead migrations, optimize ETL, and work with cloud data warehouses and data lakehouse architectures. Expect a challenging, collaborative environment with agile practices and customer-facing responsibilities.

Qualifications

• Ability to obtain and maintain a U.S. government clearance.
• Bachelor's degree and 8+ years of experience in data engineering or 6+ years with a Master's degree; or 12+ years with no degree.
• 2-4 years industry experience coding commercial software and passion for solving complex problems.
• 2-4 years direct experience in Data Engineering with Databricks, Spark, SQL, and AWS.
• Experience with Data Lakehouse architectures and Delta Lake/Iceberg is a plus.

Responsibilities

• Lead and architect migrations of data using Databricks focusing on performance, reliability, and scalability.
• Assess and understand ETL jobs, data marts, BI tools, and reports.
• Address inquiries on customization, integration, and enterprise architecture of data products.
• Support an Agile SDLC and contribute to the growth of the AI & Data Exploitation Practice.

Skills

Databricks

SQL

PySpark/Python

AWS

Airflow

Delta Lake

Data Pipelines

Big data tools

Education

Bachelor's degree

Master's degree

Associate's degree

No degree alternative

Tools

Databricks

Apache Spark

Delta Lake

Informatica EDC

Unity Catalog

Purview

Job description

Steampunk is seeking a seasoned Data Engineer to design and deliver enterprise-grade data platforms, services and pipelines using Databricks. The role requires strong communication skills and a passion for data and problem solving.

You will lead migrations, optimize ETL, and work with cloud data warehouses and data lakehouse architectures. Expect a challenging, collaborative environment with agile practices and customer-facing responsibilities.