Databricks Platform Administrator, Sr SME

SiloSmashers; Arlington (VA); On-site; USD 130,000 - 180,000; Full time

Job summary

SiloSmashers is hiring a Databricks Platform Administrator to support digital transformation for a government customer. You will architect, develop, optimize, and maintain high-performance data pipelines in Databricks Lakehouse environments.

Collaboration with federal technical teams and governance personnel is required. Required are 8+ years of experience with cloud-based data platforms, Databricks certification, and a degree or equivalent experience.

Qualifications

• 8+ years administering cloud-based data platforms with IAM and compute governance.
• Databricks Certified Platform Administration accreditation required.
• Bachelor’s degree in CS/IS/Engineering or 5+ years equivalent experience.

Responsibilities

• Architect, develop, optimize, and maintain high-performance data pipelines in Databricks Lakehouse environments.
• Collaborate with federal technical teams and cross-task platform, SRE, governance, privacy, and development personnel.
• Ensure security, access control, and governance across the platform.

Skills

Cluster & job policies

SCIM/REST

Monitoring & observability

Access audits

Tags & data governance

Unity Catalog

Workspaces & compute governance

User/service principal management

Education

Bachelor's degree in CS/IS/Engineering or 5+ years equivalent experience

Tools

Databricks

Job description

Position Overview

SiloSmashers is hiring for a Databricks Platform Administrator to support digital transformation efforts for a government customer. The selected candidate will serve as part of a team responsible for architecting, developing, optimizing, and maintaining high‑performance data ingestion, transformation, streaming, and analytical pipelines within Databricks‑enabled Lakehouse environments. This role is expected to collaborate closely with the federal technical teams, and cross‑task platform, SRE, governance, privacy, and development personnel.

Required Skills

• Hands‑on experience configuring and implementing cluster/job, pipeline, and SQL warehouse policies; experience working with secret scopes;
• Experience implementing SCIM/REST for identity and access management;
• Working knowledge of platform monitoring and observability tools and (e.g. Unity Catalog system tables, platform usage/DBU consumption, auditing user/group/service principal access and activity, Lakehouse Monitoring).
• Experience conducting access and sharing policy audits; validating user, group, and data‑asset permissions against data‑owner/steward‑defined policies and ensuring enforcement is applied consistently within and among enterprise platforms.
• Experience applying and enforcing tags for data and resources such as compute (SQL warehouses, classic compute, serverless compute, etc.), jobs, pipelines, and Databricks Apps.
• Experience managing workspaces, clusters/pools, jobs, Unity Catalog objects, secret scopes, and cluster policies.
• Experience managing user accounts, service principals, and groups.

Mandatory Qualifications & Requirements

• Ability to obtain and maintain a Public Trust clearance.
• Databricks Certified Platform Administration accreditation required.
• Eight (8) or more years of experience (5 of which must be within the last 8 years) administering cloud‑based data platforms, including workspace configuration, identity/access management, and compute governance in Databricks, AWS, Azure, or equivalent environments.
• Bachelor's degree in computer science, information systems, engineering, or a related field; or five (5) or more years of equivalent experience in lieu of a degree.
• This position requires regular, physical attendance at customer sites.