Senior Databricks Engineer — Governed Delta Lake Pipelines

Georgia Pacific Corp.; Atlanta (GA); Hybrid; USD 140,000 - 170,000; Full time

Benefits offered by this job

Medical, dental, vision

Flexible spending accounts

Retirement

Paid vacation

Job summary

Georgia-Pacific is hiring a Senior Databricks Data Engineer to join the Data Platform team in Atlanta, GA (hybrid). The role focuses on building and improving Databricks-native data engineering solutions that are governed, scalable, and aligned with enterprise standards for data quality, security, and reliability.

This role is based at Georgia-Pacific headquarters on Peachtree St in Atlanta, Georgia, with a hybrid schedule that expects three (3) days in the office per week.

Qualifications

• Production-grade Databricks, Delta Lake, and Apache Spark pipelines experience for batch and streaming workloads.
• Experience building Databricks Jobs, Lakeflow Declarative Pipelines, and Structured Streaming, with scheduling and monitoring.
• IaC deployment automation using Terraform or Databricks Asset Bundles, plus Git and CI/CD.
• Data governance via Unity Catalog with permissions, lineage, and metadata controls.
• Proficiency in Python and Spark diagnostic tools to optimize workloads.
• Legal authorization to work permanently in the United States.

Responsibilities

• Design, build, deploy, and support Databricks-native data solutions.
• Develop governed data platforms to improve accuracy, consistency, accessibility, and trust.
• Create automated tools and reusable templates for data development and ingestion.
• Operate and improve platform with monitoring, migrations, and cost optimization.
• Partner with product owners and teams to identify use cases and drive adoption.
• Integrate Databricks pipelines with governance capabilities (metadata, lineage, classification, ownership, data-quality).
• Develop governed data assets for AI and analytics (semantic models, APIs, Genie Spaces, AI agents).
• Implement validation, monitoring, remediation for critical data assets.

Skills

Databricks

Delta Lake

Apache Spark

Python

CI/CD

Terraform

Git

Structured Streaming

Unity Catalog

Lakeflow

Tools

Databricks Jobs

Auto Loader

Databricks Asset Bundles

Job description

Georgia-Pacific is hiring a Senior Databricks Data Engineer to join the Data Platform team in Atlanta, GA (hybrid). The role focuses on building and improving Databricks-native data engineering solutions that are governed, scalable, and aligned with enterprise standards for data quality, security, and reliability.

This role is based at Georgia-Pacific headquarters on Peachtree St in Atlanta, Georgia, with a hybrid schedule that expects three (3) days in the office per week.