Senior Data Engineer — Enterprise Data Platform Lead

Steampunk, Inc.; McLean (VA); On-site; USD 125,000 - 165,000; Full time

Job summary

Steampunk seeks a seasoned Senior Data Engineer to partner with clients and build enterprise-grade data platforms, pipelines, and services. You will combine deep technical expertise with strong communication to solve complex data challenges.

Responsibilities include migrating data environments for performance and reliability, designing data warehouses in cloud environments (AWS/Azure/GCP), and leveraging Databricks and Microsoft Purview to enable scalable data exploitation across the stack.

Qualifications

• Bachelor's degree required; 10+ years total experience in data engineering.
• Experience with big data tools (Hadoop, Spark, Kafka).
• Proficiency with relational and NoSQL databases (Postgres, Cassandra).
• Strong experience with data pipelines/workflow tools (Airflow, Azkaban, Luigi).
• Cloud platform experience across AWS, Azure, or GCP.
• Experience with Databricks and Microsoft Purview.
• Experience with data modeling, data warehousing, and transactional data systems.
• Experience in Agile environments and with data-exploitation initiatives.

Responsibilities

• Lead and architect migration of data environments for performance and reliability.
• Assess ETL jobs, workflows, BI tools, and reports.
• Design and develop data warehouse solutions in cloud environments (AWS/Azure/GCP).
• Develop scalable data solutions using Databricks.
• Leverage Microsoft Purview for data cataloging, lineage, and metadata management.
• Support an Agile software development lifecycle.
• Contribute to growth of Data Exploitation Practice.

Skills

Communication skills

Customer service

Education

Bachelor's degree

10+ years total experience

Tools

Hadoop

Spark

Kafka

Postgres

Cassandra

Azkaban

Luigi

Airflow

AWS

Azure

GCP

Storm

Spark-Streaming

Solr

Lucene

Elasticsearch

Python

Java

C++

Scala

Job description

Steampunk seeks a seasoned Senior Data Engineer to partner with clients and build enterprise-grade data platforms, pipelines, and services. You will combine deep technical expertise with strong communication to solve complex data challenges.

Responsibilities include migrating data environments for performance and reliability, designing data warehouses in cloud environments (AWS/Azure/GCP), and leveraging Databricks and Microsoft Purview to enable scalable data exploitation across the stack.