Sr Data Engineer - Databricks

Georgia Pacific Corp.; Atlanta (GA); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Georgia-Pacific is seeking a Senior Databricks Data Engineer to join our Data Platform team in Atlanta, Georgia. You will build and enhance the Databricks platform, create scalable data pipelines, and establish reusable engineering patterns aligned with governance and data-quality standards.

The role is hybrid with three in-office days per week at GP HQ on Peachtree St, Atlanta, GA. You will collaborate with Data Governance and other platform teams to deliver governed data assets for enterprise

Qualifications

• Experience designing and maintaining production Databricks pipelines (Delta Lake, Spark).
• Proficient in Python for data engineering tasks and ETL pipelines.
• Hands-on with infrastructure as code (Terraform) and Git workflows.
• Knowledge of data governance with Unity Catalog is a plus.
• Experience with data governance, security, and data quality practices.
• Legal authorization to work in the United States without sponsorship.

Responsibilities

• Design, build, deploy, and support Databricks pipelines including Delta Lake, Lakeflow, Databricks Jobs, Auto Loader, and Unity Catalog resources; automate CI/CD.
• Develop reliable, governed data platforms and pipelines that improve data accuracy, accessibility, consistency, and trust.
• Create automated tools, reusable templates, and self-service patterns to accelerate data development and ingestion.
• Monitor platform performance, resolve incidents, manage migrations and upgrades, and optimize costs.
• Collaborate with product owners, operations, architects, and delivery teams to prioritize and expand adoption.
• Integrate pipelines with governance, metadata, lineage, certification, ownership, and data-quality capabilities.
• Develop governed data assets for AI use cases, including semantic models and APIs.
• Implement validation rules and remediation for critical data assets.

Skills

Databricks

Delta Lake

Apache Spark

Python

Terraform

Git

CI/CD

Unity Catalog

Lakeflow Declarative Pipelines

Automation

Tools

Terraform

Git

CI/CD Pipelines

Unity Catalog

Lakeflow Declarative Pipelines

Job description

Your Job

Georgia-Pacific is seeking a Senior Databricks Data Engineer to join our Data Platform team in Atlanta, Georgia. In this role, you will create long-term value across four business units by expanding access to trusted, high-quality data spanning hundreds of systems and thousands of data assets. You will build and enhance our Databricks platform, deliver reliable and scalable data pipelines, and help establish reusable engineering patterns that align with enterprise architecture, governance, security, and data-quality standards.

This role is based in Atlanta, GA at our GP HQ located on Peachtree St. It is hybrid with an expectation of three (3) days in office per week.

Our Team

The Georgia-Pacific Data Platform team partners with Data Governance, Data Delivery, Data Product Owners, Solution Architects, and other platform and product teams. Together, the team develops governed, reusable capabilities that improve data accessibility, reliability, lineage, and quality while supporting analytics, advanced analytics, and AI use cases across the enterprise.

What You Will Do

• Design, build, deploy, and support Databricks-native data engineering solutions, including Delta Lake pipelines, Lakeflow Declarative Pipelines, Databricks Jobs, Auto Loader ingestion pipelines, Unity Catalog resources, and CI/CD automation


• Develop reliable, governed data platforms and pipelines that improve the accuracy, consistency, accessibility, and trustworthiness of enterprise data assets


• Create automated tools, reusable templates, and self-service patterns that accelerate data development, ingestion, feature engineering, and consumption


• Operate and improve the platform through performance monitoring, incident resolution, migrations, upgrades, observability, and cost optimization aligned with long-term scalability and resilience goals


• Partner with product owners, operations teams, architects, and delivery teams to identify common use cases, prioritize platform enhancements, and expand adoption


• Integrate Databricks pipelines with enterprise governance, metadata, lineage, classification, certification, ownership, and data-quality capabilities


• Develop and curate governed data assets for AI and advanced analytics use cases, including semantic models, APIs, Genie Spaces, and AI agents


• Implement validation rules, monitoring, and remediation processes that improve the fitness and reliability of critical data assets

Who You Are (Basic Qualifications)

• Experience designing, building, and supporting production-grade Databricks, Delta Lake, and Apache Spark pipelines for batch and streaming workloads


• Experience developing Databricks Jobs (i.e. Lakeflow Declarative Pipelines, Structured Streaming) and multi-task workflows, including scheduling, parameters, dependencies, retries, notifications, and operational monitoring


• Experience implementing Databricks infrastructure and environment-aware deployment automation using Terraform, Databricks Asset Bundles, or other Infrastructure as Code practices, Git, and CI/CD workflows


• Experience implementing data governance and access controls with Unity Catalog, including catalogs, schemas, tables, views, external locations, storage credentials, lineage, and fine-grained permissions


• Experience using Python and Spark diagnostic tools, including job logs, Spark UI, query plans, partitioning, join optimization, and Adaptive Query Execution, to troubleshoot and optimize production data workloads


• Must have legal authorization to work permanently in the United States for any employer without requiring a visa transfer or visa sponsorship

What Will Put You Ahead

• Experience building production ingestion pipelines with Databricks Auto Loader


• Advanced Python experience applied to data engineering, automation, reusable libraries, and platform capabilities


• Experience with open table formats such as Delta Lake, Apache Hudi, or Apache Iceberg


• Experience developing governed data assets for AI, semantic modeling, APIs, advanced analytics, Genie Spaces, or AI agents


• Experience with AWS, Microsoft Azure, or Google Cloud and native storage services such as Amazon S3, Azure Data Lake Storage Gen2, OneLake, or Google Cloud Storage

Hiring Philosophy

All Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here.

Who We Are

Georgia-Pacific and its subsidiaries are among the world's leading manufacturers and marketers of bath tissue, paper towels and napkins, tableware, paper-based packaging, cellulose, specialty fibers, and building products. Our products are part of everyday life for people around the world.

At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.

Our Benefits

Our goal is for each employee, and their families, to live fulfilling and healthy lives. We provide essential resources and support to build and maintain physical, financial, and emotional strength, focusing on overall wellbeing so you can focus on what matters most. Our benefits plan includes medical, dental, vision, flexible spending and health savings accounts, life insurance, AD&D, disability, retirement, paid vacation/time off, educational assistance, and may also include infertility assistance, paid parental leave, and adoption assistance. Specific eligibility criteria are set by the applicable Summary Plan Description, policy, or guideline, and benefits may vary by geographic region. If you have questions about which benefits apply to you, please speak to your recruiter.

Equal Opportunities

Equal Opportunity Employer, including disability and protected veteran status. Except where prohibited by state law, all offers of employment are conditioned upon successfully passing a drug test. This employer uses E-Verify. Please review the E-Verify information for additional details.