Remote Data Cloud Engineer — Secret Clearance

Zachary Piper Solutions; United States; Remote; USD 120,000 - 140,000; Full time

Job summary

Zachary Piper Solutions is seeking an experienced Data Cloud Engineer for a fully remote opportunity. This role supports a long-term Department of Defense modernization initiative focused on multi-cloud data integration, secure data architecture, and mission-critical analytics.

Candidates must hold an active Secret Clearance. Responsibilities include designing scalable cloud ETL/ELT pipelines, building data transformations with PySpark/Spark SQL, developing ingestion frameworks, and implementing

Qualifications

• Active Secret Clearance.
• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or related field.
• 8+ years of data engineering experience.
• Strong hands-on experience with PySpark, Spark SQL, Python, and SQL.
• Experience with Azure Synapse Analytics, Databricks, and/or AWS data services.
• Experience building and supporting production-grade ETL/ELT pipelines.
• Experience with data ingestion, integration, transformation, and CDC.
• Experience troubleshooting production data environments and implementing monitoring and logging.

Responsibilities

• Design, develop, and maintain scalable cloud-based ETL/ELT pipelines using Azure and AWS technologies.
• Build and optimize large-scale data transformations using PySpark and Spark SQL.
• Develop data ingestion frameworks supporting structured and unstructured data, including databases, APIs, JSON, and flat files.
• Implement full and incremental data loading strategies, including Change Data Capture (CDC).
• Design and support enterprise data lakes, data warehouses, and analytics environments.
• Implement data quality, governance, and security controls including schema validation and RBAC.
• Monitor, troubleshoot, and optimize production data pipelines.
• Support CI/CD implementation and automated deployments.
• Partner with cloud engineering, cybersecurity, DevOps, and software development teams.

Skills

PySpark

Spark SQL

Python

SQL

Azure

AWS

Education

Bachelor's degree in CS, Engineering, IS, Data Science, or related field

Tools

Azure Synapse Analytics

Databricks

AWS data services

Job description

Zachary Piper Solutions is seeking an experienced Data Cloud Engineer for a fully remote opportunity. This role supports a long-term Department of Defense modernization initiative focused on multi-cloud data integration, secure data architecture, and mission-critical analytics.

Candidates must hold an active Secret Clearance. Responsibilities include designing scalable cloud ETL/ELT pipelines, building data transformations with PySpark/Spark SQL, developing ingestion frameworks, and implementing