Databricks Platform Engineer/Admin

Vital Tech Solutions; Washington (District of Columbia); Remote; USD 140,000 - 170,000; Full time

Job summary

Vital Tech Solutions is seeking a Senior Databricks Platform Engineer/Administrator to design, deploy, govern, and support enterprise Databricks environments for federal clients. This remote role requires an active Secret clearance and US citizenship.

You will lead ground-up workspace deployment using Terraform, manage Unity Catalog, and implement robust CI/CD pipelines across AWS GovCloud and commercial regions. Strong preference for AWS networking, security, and governance expertise.

Qualifications

• 6+ years of experience engineering, administering, or supporting Databricks platforms.
• Strong hands-on experience with Databricks in AWS environments.
• Advanced Terraform experience supporting networking, IAM, compute, and storage.
• Experience administering Unity Catalog and data governance.
• Familiarity with CI/CD practices and deployment automation.

Responsibilities

• Deploy and configure Databricks workspaces from ground up using Terraform and reference architecture across dev, test, prod.
• Support Databricks deployments within AWS Commercial and GovCloud.
• Design and implement AWS networking (VPCs, subnets, PrivateLink, Transit Gateway, security groups, DNS).
• Manage Databricks control-plane and data-plane connectivity.
• Administer Unity Catalog including metastores, catalogs, schemas, locations, and security.
• Build and maintain CI/CD pipelines for infrastructure deployment and Databricks Asset Bundles.
• Establish platform governance, guardrails, tagging, naming conventions, and operational best practices.
• Automate provisioning and administration of cluster policies, secrets, service principals, SSO, and SCIM.
• Monitor platform health, utilization, performance, and cost; identify optimization opportunities.
• Serve as escalation point for platform incidents and root-cause analysis.
• Collaborate with stakeholders to guide platform architecture, governance, security, and operations.

Skills

Communication

Problem Solving

Python

Linux

CI/CD

Terraform

Databricks

Unity Catalog

Cloud Networking

AWS

Networking

VPC

IAM

S3

KMS

EC2

CloudWatch

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field

Tools

Terraform

Databricks

Unity Catalog

CI/CD

Python

Linux

AWS

VPC

IAM

S3

KMS

EC2

CloudWatch

Job description

Job Description

Job Description

This is a remote position.

Location:

Remote – United States

Security Clearance:

Active Secret or higher

REQUIRED

Our client, a growing technology services organization supporting federal government programs, is seeking an experienced

Senior Databricks Platform Engineer / Administrator

to help design, deploy, govern, and support enterprise Databricks environments for a federal client.

Candidates must currently hold an

ACTIVE Secret security clearance or higher

. Candidates without an active Secret-level clearance cannot be considered.

The ideal candidate will bring deep hands‑on experience building and administering Databricks platforms, particularly within AWS environments, with strong expertise in infrastructure automation, networking, governance, security, CI/CD, and platform operations.

• ResponsibilitiesDeploy and configure Databricks workspaces from the ground up using Terraform and Databricks Secure Reference Architecture across development, test, and production environments.
• Support Databricks deployments within AWS Commercial and AWS GovCloud environments.
• Design and implement supporting AWS networking architecture, including VPCs, subnets, PrivateLink, Transit Gateway, security groups, and DNS.
• Manage Databricks control‑plane and data‑plane connectivity.
• Administer Unity Catalog, including metastores, catalogs, schemas, external locations, permissions, grants, and row- and column-level security.
• Build and maintain CI/CD pipelines supporting infrastructure deployment and Databricks Asset Bundles.
• Establish platform governance standards, architectural guardrails, tagging strategies, naming conventions, and operating best practices.
• Automate provisioning and administration of cluster policies, secrets, service principals, SSO, and SCIM integrations.
• Monitor platform health, utilization, performance, and cost.
• Identify opportunities for rightsizing, cost optimization, and improved platform efficiency.
• Serve as an escalation point for platform incidents, troubleshooting, and root‑cause analysis.
• Partner with technical and business stakeholders to provide guidance on platform architecture, governance, security, and operational decisions.

Requirements

• Active Secret security clearance or higher is required.
• U.S. citizenship required.
• 6+ years of experience engineering, administering, or supporting Databricks platforms.
• Strong hands‑on experience with Databricks in AWS environments.
• Advanced Terraform experience supporting infrastructure such as networking, IAM, compute, and storage.
• Strong knowledge of Databricks Secure Reference Architecture.
• Hands‑on Unity Catalog administration experience.
• Experience with Databricks Asset Bundles or comparable deployment automation frameworks.
• Strong understanding of CI/CD practices and infrastructure‑as‑code methodologies.
• Python proficiency.
• Linux systems administration experience.
• Hands‑on experience with AWS services including:
• VPC
• IAM
• S3
• KMS
• EC2
• CloudWatch
• Strong troubleshooting and root‑cause analysis capabilities.
• Strong communication skills with the ability to advise stakeholders on technical and platform decisions.

Preferred Qualifications

• AWS GovCloud experience.
• Experience working within regulated, security‑sensitive, or compliance‑heavy environments.
• Experience supporting FISMA High, FedRAMP High, or comparable federal security standards.
• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.