Remote Data Cloud Engineer with Secret Clearance

Piper Companies; United States; Remote; USD 120,000 - 140,000; Full time

Job summary

Zachary Piper Solutions seeks an experienced Data Cloud Engineer to support a DoD modernization initiative, designing scalable data solutions across Azure and AWS. The role is fully remote, requiring an active Secret Clearance to ensure security and compliance.

You will drive enterprise cloud transformation, build secure data pipelines, and collaborate with cross-functional teams to deliver analytics-ready environments.

Qualifications

• Active Secret Clearance.
• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or related technical discipline.
• 10+ years of experience designing and supporting enterprise-scale data engineering solutions.
• Strong expertise with PySpark, Spark SQL, Python, and SQL.
• Experience building cloud-native data pipelines in Azure Synapse Analytics, Databricks, and/or AWS Glue.
• Experience with data ingestion, integration, and transformation of structured and unstructured data.
• Experience implementing CDC methodologies and incremental load frameworks.
• Knowledge of data governance, access controls, and data quality methodologies.
• Experience supporting production environments and troubleshooting operational issues.

Responsibilities

• Design, develop, and maintain scalable cloud-based ETL/ELT pipelines using Azure and AWS technologies.
• Build and optimize large-scale data transformation solutions utilizing PySpark and Spark SQL.
• Develop ingestion frameworks supporting structured and unstructured data sources, including relational databases, APIs, JSON, and flat files.
• Implement full and incremental data loading strategies, including Change Data Capture (CDC).
• Design and support enterprise data lakes, data warehouses, and analytics-ready environments.
• Establish data quality, governance, and security controls including schema validation, RBAC, lineage tracking, and credential management.
• Monitor, troubleshoot, and improve the performance and reliability of cloud data pipelines.
• Support CI/CD implementation and automated deployment processes.
• Partner closely with cloud engineering, cybersecurity, DevOps, and software development teams to support modernization initiatives.
• Ensure solutions remain compliant with DoD security requirements and best practices.

Skills

PySpark

Spark SQL

Python

SQL

Data engineering

Azure

AWS

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or related field

Tools

Azure Synapse Analytics

Databricks

AWS Glue

Azure Data Factory

Redshift

Oracle databases

Job description

Zachary Piper Solutions seeks an experienced Data Cloud Engineer to support a DoD modernization initiative, designing scalable data solutions across Azure and AWS. The role is fully remote, requiring an active Secret Clearance to ensure security and compliance.

You will drive enterprise cloud transformation, build secure data pipelines, and collaborate with cross-functional teams to deliver analytics-ready environments.