Remote Data Cloud Engineer – DoD (Secret Clearance)

Piper Companies; Fort Meade (MD); Remote; USD 125,000 - 140,000; Full time

Job summary

Zachary Piper Solutions seeks a Data Cloud Engineer to modernize DoD enterprise data infrastructure, building scalable pipelines and secure data lakes in a remote role based from Fort Meade, VA. You will implement CI/CD for data pipelines, ensure data quality, and collaborate across cybersecurity, cloud, and DevOps teams to meet RMF/DMF requirements.

The role requires 10+ years of experience with Azure Synapse or Databricks, PySpark, and strong Python/SQL skills.

Qualifications

• 10+ years of experience designing and operating scalable, production-grade data pipelines using Azure Synapse and/or Databricks, with a Bachelor’s degree in Computer Science, Data Science, Engineering, Information Systems, or a related field.
• Strong hands-on PySpark development experience with high-performance ETL pipelines.
• Advanced experience with Spark SQL, Python, and SQL for large-scale data transformation and optimization.
• Experience ingesting structured and unstructured data and implementing full/incremental loads, CDC, and rerunnable pipeline architectures.
• Experience with data governance, RBAC, credential management, and pipeline monitoring.

Responsibilities

• Design, develop, and maintain production-grade ETL/ELT pipelines with PySpark focusing on performance.
• Build scalable data pipelines using Azure Synapse Analytics, Databricks, AWS Glue, and related cloud technologies.
• Develop ingestion frameworks for structured and unstructured data (relational, JSON, flat files, REST APIs).
• Implement full and incremental data loads, including CDC and late-arriving data.
• Design and maintain cloud data lakes/warehouses and analytics-ready datasets.
• Implement data quality controls, schema validation, and lineage with RBAC and cataloging.
• Monitor pipelines for performance, latency, and reliability; troubleshoot issues.

Skills

PySpark

Spark SQL

Python

SQL

CI/CD

DevOps

RBAC

Credential management

Data governance

Data ingestion

Education

Bachelor's degree in Computer Science / Data Science / Engineering / Information Systems

Tools

Azure Synapse Analytics

Databricks

AWS Glue

Azure Data Factory

Redshift

S3

Job description

Zachary Piper Solutions seeks a Data Cloud Engineer to modernize DoD enterprise data infrastructure, building scalable pipelines and secure data lakes in a remote role based from Fort Meade, VA. You will implement CI/CD for data pipelines, ensure data quality, and collaborate across cybersecurity, cloud, and DevOps teams to meet RMF/DMF requirements.

The role requires 10+ years of experience with Azure Synapse or Databricks, PySpark, and strong Python/SQL skills.