Databricks Platform Engineer - Scale, Governance & Security

ecsfederal; Virginia (MN); Hybrid; USD 140,000 - 165,000; Full time

Job summary

Everforth ECS in Arlington, VA (Hybrid) is seeking a Senior Databricks Platform Engineer to design, implement, and maintain an enterprise-grade Databricks platform supporting a federal customer’s unified data initiative.

You will steward the platform, building scalable infrastructure, governance, and operational excellence with secondary data engineering duties to optimize the platform and enforce best practices.

Qualifications

• Bachelor's degree in a relevant field; 5+ years of relevant experience or 9+ years without degree.
• Proven experience building enterprise-grade Databricks platforms on AWS or Azure.
• Deep knowledge of Databricks architecture: workspaces, clusters, storage, automation.
• Expertise with Unity Catalog, security models, and RBAC.
• Experience with big data tech: Spark, Hive, Delta Lake, Hadoop.
• Cloud experience with AWS or Azure services (S3, EMR, Glue, Data Factory).
• Proficiency in SQL and Python/Scala/Bash/PowerShell.

Responsibilities

• Maintain enterprise-scale Databricks platform with multiple workspaces.
• Develop platform observability: KPIs, dashboards, monitoring for performance and cost.
• Implement scalable provisioning and de-provisioning processes.
• Design and manage RBAC frameworks and security groups.
• Integrate with identity systems (SAML, SCIM, Active Directory).
• Manage Unity Catalog and metastore configurations.
• Ensure data governance, lineage, auditing, and compliance.
• Tune compute policies, clusters, and pool management.
• Collaborate with data engineers, analysts, and scientists on models and patterns.
• Troubleshoot platform issues (connectivity, startup failures, authentication).
• Maintain documentation and stay updated with Databricks/AWS features.

Skills

Databricks

RBAC

SAML/SCIM

Unity Catalog

Spark

AWS

Azure

Security

Cost Optimization

Education

Bachelor's degree

Tools

Databricks

S3

IAM

KMS

Delta Lake

Job description

Everforth ECS in Arlington, VA (Hybrid) is seeking a Senior Databricks Platform Engineer to design, implement, and maintain an enterprise-grade Databricks platform supporting a federal customer’s unified data initiative.

You will steward the platform, building scalable infrastructure, governance, and operational excellence with secondary data engineering duties to optimize the platform and enforce best practices.