Security-Cleared Data Engineer: Cloud Data Platforms Lead

Steampunk; McLean (VA); On-site; USD 125,000 - 165,000; Full time

Job summary

Steampunk is seeking a seasoned Senior Data Engineer to build enterprise-grade data platforms, pipelines, and services while delivering strong client communications and problem-solving acumen. The role emphasizes migration architecture, ETL optimization, and cloud data solutions across AWS, Azure, or GCP.

You will work within an Agile framework to design scalable data environments, leverage Databricks and Purview, and contribute to Steampunk's Data Exploitation Practice growth.

Qualifications

• Ability to obtain and maintain a U.S. government security clearance.
• Bachelor's degree and 10+ years of total experience.
• 5-7 years of direct Data Engineering experience with listed tools.
• Experience with Databricks.
• Experience with Microsoft Purview.
• Experience with Wiz or similar cloud security platforms.
• Advanced SQL knowledge and working familiarity with relational databases.
• Experience with big data, streaming, and data warehousing.
• Experience architecting transactional data systems and data warehouses.

Responsibilities

• Lead and architect migration of data environments focused on performance and reliability.
• Assess ETL jobs, workflows, BI tools, and reports.
• Address inquiries on customization, enterprise architecture, and data products.
• Design and develop database and data warehouse solutions in AWS/Azure/GCP.
• Design, develop, and optimize pipelines using Databricks.
• Leverage Purview for data cataloging, lineage, and metadata management.
• Support an Agile software development lifecycle.
• Contribute to the growth of the Data Exploitation Practice.

Skills

Communication

Problem solving

Team collaboration

Security clearance eligible

Education

Bachelor's degree

Tools

Hadoop

Spark

Kafka

Postgres

Cassandra

Azkaban

Luigi

Airflow

AWS

Azure

GCP

Storm

Spark-Streaming

Solr

Lucene

Elasticsearch

Python

Java

C++

Scala

Databricks

Microsoft Purview

Wiz

Job description

Steampunk is seeking a seasoned Senior Data Engineer to build enterprise-grade data platforms, pipelines, and services while delivering strong client communications and problem-solving acumen. The role emphasizes migration architecture, ETL optimization, and cloud data solutions across AWS, Azure, or GCP.

You will work within an Agile framework to design scalable data environments, leverage Databricks and Purview, and contribute to Steampunk's Data Exploitation Practice growth.