Data Cloud Engineer (Remote)

Zachary Piper Solutions; United States; Remote; USD 120,000 - 140,000; Full time

Job summary

Zachary Piper Solutions is seeking an experienced Data Cloud Engineer to support a DoD modernization initiative. This fully remote role focuses on designing and implementing scalable data solutions across Azure and AWS to enable mission-critical analytics.

The ideal candidate holds an active Secret Clearance, a technical degree, and 10+ years in enterprise data engineering, with strong PySpark, Spark SQL, Python, and SQL expertise.

Qualifications

• Active Secret Clearance.
• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or related technical discipline.
• 10+ years of experience designing and supporting enterprise-scale data engineering solutions.
• Strong expertise with PySpark, Spark SQL, Python, and SQL.
• Experience building cloud-native data pipelines in Azure Synapse Analytics, Databricks, and/or AWS Glue.
• Experience with data ingestion, integration, and transformation of structured and unstructured data.
• Experience implementing CDC methodologies and incremental load frameworks.
• Knowledge of data governance, access controls, and data quality methodologies.
• Experience supporting production environments and troubleshooting operational issues.

Responsibilities

• Design, develop, and maintain scalable cloud-based ETL/ELT pipelines using Azure and AWS technologies.
• Build and optimize large-scale data transformation solutions utilizing PySpark and Spark SQL.
• Develop ingestion frameworks supporting structured and unstructured data sources, including relational databases, APIs, JSON, and flat files.
• Implement full and incremental data loading strategies, including Change Data Capture (CDC).
• Design and support enterprise data lakes, data warehouses, and analytics-ready environments.
• Establish data quality, governance, and security controls including schema validation, RBAC, lineage tracking, and credential management.
• Monitor, troubleshoot, and improve the performance and reliability of cloud data pipelines.
• Support CI/CD implementation and automated deployment processes.
• Partner closely with cloud engineering, cybersecurity, DevOps, and software development teams to support modernization initiatives.
• Ensure solutions remain compliant with DoD security requirements and best practices.

Skills

PySpark

Spark SQL

Python

SQL

Education

Bachelor's degree in Computer Science/Engineering/IS/Data Science or related field

Tools

Azure Synapse Analytics

Databricks

AWS Glue

Job description

Zachary Piper Solutions is seeking an experienced Data Cloud Engineer to support a high-profile Department of Defense modernization initiative. This position offers the opportunity to drive enterprise cloud transformation efforts by designing and implementing scalable, secure, and modern data solutions across Azure and AWS cloud environments supporting mission-critical analytics and decision-making capabilities. This position is fully remote. Candidates must hold an active Secret Clearance.

Responsibilities

• Design, develop, and maintain scalable cloud-based ETL/ELT pipelines using Azure and AWS technologies.
• Build and optimize large-scale data transformation solutions utilizing PySpark and Spark SQL.
• Develop ingestion frameworks supporting structured and unstructured data sources, including relational databases, APIs, JSON, and flat files.
• Implement full and incremental data loading strategies, including Change Data Capture (CDC).
• Design and support enterprise data lakes, data warehouses, and analytics-ready environments.
• Establish data quality, governance, and security controls including schema validation, RBAC, lineage tracking, and credential management.
• Monitor, troubleshoot, and improve the performance and reliability of cloud data pipelines.
• Support CI/CD implementation and automated deployment processes.
• Partner closely with cloud engineering, cybersecurity, DevOps, and software development teams to support modernization initiatives.
• Ensure solutions remain compliant with DoD security requirements and best practices.

Required Qualifications

• Active Secret Clearance.
• Bachelor's degree in Computer Science, Engineering, Information Systems, Data Science, or related technical discipline.
• 10+ years of experience designing and supporting enterprise-scale data engineering solutions.
• Strong expertise with PySpark, Spark SQL, Python, and SQL.
• Experience building cloud-native data pipelines in Azure Synapse Analytics, Databricks, and/or AWS Glue.
• Experience with data ingestion, integration, and transformation of structured and unstructured data.
• Experience implementing CDC methodologies and incremental load frameworks.
• Knowledge of data governance, access controls, and data quality methodologies.
• Experience supporting production environments and troubleshooting operational issues.

Preferred Qualifications

• Experience with Azure Data Factory, Redshift, Amazon S3, and Oracle databases.
• Experience supporting federal or DoD cloud modernization programs.
• Familiarity with RMF, STIG, and FedRAMP compliance frameworks.
• Experience working in Agile development environments.

Salary and Benefits Include:

• Salary 120,000-140,000+ depending on experience