Remote Databricks Data Engineer — Active Secret Clearance

Zohorecruit; Washington (District of Columbia); Remote; USD 120,000 - 160,000; Full time

Job summary

Vital Tech Solutions is seeking a Databricks Data Engineer for a federal technology initiative. This remote role requires an active Secret clearance and US citizenship; work will involve building batch and streaming pipelines in Databricks with PySpark and SQL, plus data modeling and ingestion frameworks.

You will collaborate with engineers and federal program stakeholders throughout the development lifecycle, implementing Delta Live Tables, Unity Catalog permissions, and scalable architectures

Qualifications

• Active Secret security clearance or higher required.
• 5+ years professional data engineering experience.
• 2+ years hands-on Databricks experience.
• Strong PySpark and SQL production-level experience.
• Experience developing both batch and streaming data pipelines.
• Strong data modeling and modern data architecture knowledge.
• Python proficiency and Git-based development experience.
• Familiarity with Unity Catalog permissions and ingestion from multiple sources.

Responsibilities

• Design, build, and maintain batch and streaming data pipelines with PySpark, SQL, Databricks Workflows, and Delta Live Tables.
• Implement Medallion Architecture across bronze, silver, and gold data layers.
• Develop scalable ingestion frameworks for structured, semi-structured, and unstructured data.
• Integrate data from databases, APIs, files, and streaming sources (Kafka, Kinesis, Databricks Auto Loader).
• Design dimensional and domain-specific data models for analytics and downstream apps.
• Build and consume APIs for integration with downstream systems.
• Optimize Spark workloads for performance and cost via partitioning and caching.
• Maintain data quality checks, validation, and pipeline monitoring.
• Document data flows, lineage, architecture, and integration points.
• Collaborate with engineering, platform, architecture, and federal stakeholders throughout the lifecycle.

Skills

Databricks

PySpark

SQL

Python

Data Modeling

CI/CD

Git

Data Pipelines

Cloud Platforms

Education

Bachelor's degree in Computer Science / Engineering / IT

Tools

Databricks Unity Catalog

Databricks Workflows

Delta Live Tables

Kafka

Kinesis

Databricks Auto Loader

Git-based CI/CD

Job description

Vital Tech Solutions is seeking a Databricks Data Engineer for a federal technology initiative. This remote role requires an active Secret clearance and US citizenship; work will involve building batch and streaming pipelines in Databricks with PySpark and SQL, plus data modeling and ingestion frameworks.

You will collaborate with engineers and federal program stakeholders throughout the development lifecycle, implementing Delta Live Tables, Unity Catalog permissions, and scalable architectures