Remote Data Cloud Engineer with Secret Clearance

Zachary Piper Solutions; United States; Remote; USD 120,000 - 140,000; Full time

Job summary

Zachary Piper Solutions is seeking an experienced Data Cloud Engineer to support a DoD modernization initiative. This fully remote role focuses on designing and implementing scalable data solutions across Azure and AWS to enable mission-critical analytics.

The ideal candidate holds an active Secret Clearance, a technical degree, and 10+ years in enterprise data engineering, with strong PySpark, Spark SQL, Python, and SQL expertise.

Qualifications

• Active Secret Clearance.
• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or related technical discipline.
• 10+ years of experience designing and supporting enterprise-scale data engineering solutions.
• Strong expertise with PySpark, Spark SQL, Python, and SQL.
• Experience building cloud-native data pipelines in Azure Synapse Analytics, Databricks, and/or AWS Glue.
• Experience with data ingestion, integration, and transformation of structured and unstructured data.
• Experience implementing CDC methodologies and incremental load frameworks.
• Knowledge of data governance, access controls, and data quality methodologies.
• Experience supporting production environments and troubleshooting operational issues.

Responsibilities

• Design, develop, and maintain scalable cloud-based ETL/ELT pipelines using Azure and AWS technologies.
• Build and optimize large-scale data transformation solutions utilizing PySpark and Spark SQL.
• Develop ingestion frameworks supporting structured and unstructured data sources, including relational databases, APIs, JSON, and flat files.
• Implement full and incremental data loading strategies, including Change Data Capture (CDC).
• Design and support enterprise data lakes, data warehouses, and analytics-ready environments.
• Establish data quality, governance, and security controls including schema validation, RBAC, lineage tracking, and credential management.
• Monitor, troubleshoot, and improve the performance and reliability of cloud data pipelines.
• Support CI/CD implementation and automated deployment processes.
• Partner closely with cloud engineering, cybersecurity, DevOps, and software development teams to support modernization initiatives.
• Ensure solutions remain compliant with DoD security requirements and best practices.

Skills

PySpark

Spark SQL

Python

SQL

Education

Bachelor's degree in Computer Science/Engineering/IS/Data Science or related field

Tools

Azure Synapse Analytics

Databricks

AWS Glue

Job description

Zachary Piper Solutions is seeking an experienced Data Cloud Engineer to support a DoD modernization initiative. This fully remote role focuses on designing and implementing scalable data solutions across Azure and AWS to enable mission-critical analytics.

The ideal candidate holds an active Secret Clearance, a technical degree, and 10+ years in enterprise data engineering, with strong PySpark, Spark SQL, Python, and SQL expertise.