Remote Databricks Data Engineer with Secret Clearance

Zohorecruit; United States; Remote; USD 130,000 - 160,000; Full time

Job summary

Vital Tech Solutions is seeking an experienced Databricks Data Engineer for a federal technology initiative. This remote role is available to U.S. citizens residing in the United States with an active Secret clearance or higher.

The ideal candidate will design and implement batch and streaming pipelines using PySpark, SQL, Delta Live Tables, and Databricks tooling. Responsibilities include building scalable ingestion frameworks, applying Medallion Architecture, and collaborating with

Qualifications

• Active Secret security clearance or higher is required.
• 5+ years of professional data engineering experience.
• 2+ years of hands-on Databricks experience.
• Strong production-level PySpark and SQL experience.
• Experience developing batch and streaming data pipelines.

Responsibilities

• Design, build, and maintain batch and streaming data pipelines using PySpark, SQL, Databricks Workflows, and Delta Live Tables.
• Implement Medallion Architecture across bronze, silver, and gold data layers.
• Develop scalable ingestion frameworks for structured, semi-structured, and unstructured data.
• Integrate data from databases, APIs, files, and streaming sources like Kafka, Kinesis, and Databricks Auto Loader.
• Design dimensional data models and APIs for downstream systems.
• Optimize Spark workloads for performance and cost; tune partitioning and clustering.
• Develop data quality checks, validation, and pipeline monitoring.

Skills

Databricks

PySpark

SQL

Python

Git CI/CD

Data modeling

Delta Live Tables

Spark performance tuning

Education

Bachelor's degree in CS/Engineering/IT or related

Tools

Databricks Unity Catalog

Databricks Workflows

Kafka/Kinesis

Databricks Delta Live Tables

Job description

Vital Tech Solutions is seeking an experienced Databricks Data Engineer for a federal technology initiative. This remote role is available to U.S. citizens residing in the United States with an active Secret clearance or higher.

The ideal candidate will design and implement batch and streaming pipelines using PySpark, SQL, Delta Live Tables, and Databricks tooling. Responsibilities include building scalable ingestion frameworks, applying Medallion Architecture, and collaborating with