Senior Data Engineer - Cloud Data Platforms & Pipelines

Steampunk, Inc.; McLean (VA); On-site; USD 125,000 - 165,000; Full time

Job summary

Steampunk, Inc. is seeking a seasoned Senior Data Engineer to design and scale enterprise-grade data platforms and pipelines in an AI-enabled environment.

You will collaborate with clients to migrate data environments with performance and reliability, and to understand ETL jobs, BI tools, and reports. You will lead development of cloud-based data solutions using AWS, Hadoop, and Spark, while guiding an Agile team and mentoring junior engineers.

Qualifications

• Bachelor's degree in a technical field.
• 5–7 years of industry experience in data engineering.
• Experience with Hadoop, Spark, and Kafka.
• Strong SQL and NoSQL database experience (Postgres, Cassandra).
• Public trust eligibility with US government.

Responsibilities

• Lead and architect migration of data environments with performance and reliability.
• Assess and understand the ETL jobs, workflows, BI tools, and reports.
• Address technical inquiries concerning customization, integration, enterprise architecture and general feature / functionality of data products.
• Experience in crafting database / data warehouse solutions in cloud (Preferably AWS. Alternatively Azure, GCP).
• Key must have skill sets – Python, AWS
• Support an Agile software development lifecycle
• You will contribute to the growth of our Data Exploitation Practice!

Skills

Python

AWS

SQL

NoSQL

Databricks

Spark

Kafka

Airflow

Java

C++

Education

Bachelor's Degree

Tools

Hadoop

Spark

Kafka

PostgreSQL

Cassandra

Azkaban

Luigi

Airflow

EC2

EMR

Redshift

Elasticsearch

Solr

Lucene

Azure

Job description

Steampunk, Inc. is seeking a seasoned Senior Data Engineer to design and scale enterprise-grade data platforms and pipelines in an AI-enabled environment.

You will collaborate with clients to migrate data environments with performance and reliability, and to understand ETL jobs, BI tools, and reports. You will lead development of cloud-based data solutions using AWS, Hadoop, and Spark, while guiding an Agile team and mentoring junior engineers.