Remote Databricks Platform Engineer - CI/CD & Automation

Fortis Industries, Inc. DBA - LTS, Inc.; Atmore (AL); On-site; USD 120,000 - 180,000; Full time

Job summary

PCI Professional Services is seeking a Databricks Platform Engineer for a remote contract. The role focuses on automating platform operations, delivering reliable Databricks environments, and enabling data teams to leverage the lakehouse effectively.

Responsibilities include building and maintaining Databricks workspace infrastructure, implementing CI/CD for Databricks workflows, and enforcing security/governance policies across Azure, AWS, or GCP environments.

Qualifications

• Bachelor's degree in a related discipline.
• 5+ years of experience in platform engineering, cloud infrastructure, or IT operations, with 2+ years managing Databricks environments.
• Public Trust (or higher) clearance eligibility.
• Strong knowledge of Databricks administration, including cluster setup, workspace management, and job orchestration.
• Proficiency in scripting and automation with Python, Bash, or PowerShell.

Responsibilities

• Build, maintain, and optimize the enterprise data lakehouse infrastructure.
• Platform provisioning, monitoring, cost optimization, and providing technical support for Databricks workloads.
• Build and maintain Databricks workspace infrastructure across development, staging, and production environments.
• Design, implement, and maintain Databricks platforms in cloud environments (Azure, AWS, or GCP), ensuring scalability, reliability, and cost-efficiency.
• Oversee the deployment and configuration of Databricks workspaces, including user management, access controls, and workspace policies.
• Collaborate with infrastructure and DevOps teams to implement CI/CD pipelines for deploying Databricks workflows and notebooks.
• Monitor and manage performance, logging, and system health of the Databricks platform.
• Implement robust data security and governance measures in compliance with organizational policies and standards.
• Work with cross-functional teams to troubleshoot and resolve platform-related issues.
• Automate repetitive tasks, such as provisioning, upgrades, and scaling, using Infrastructure-as-Code tools like Terraform or CloudFormation.
• Enable data engineers and data scientists by providing support for integrating Databricks with various data sources and tools.
• Stay up-to-date with the latest Databricks features, updates, and best practices to ensure the platform meets evolving business needs.

Skills

DevOps

Data engineering

Python scripting

Terraform

Cloud platforms

Spark

Education

Bachelor's degree in related discipline

Tools

Databricks

Terraform

CloudFormation

ARM templates

Job description

PCI Professional Services is seeking a Databricks Platform Engineer for a remote contract. The role focuses on automating platform operations, delivering reliable Databricks environments, and enabling data teams to leverage the lakehouse effectively.

Responsibilities include building and maintaining Databricks workspace infrastructure, implementing CI/CD for Databricks workflows, and enforcing security/governance policies across Azure, AWS, or GCP environments.