Principal Data Engineer - Hybrid Platform Architect

The Intersect Group; Atlanta (GA); Hybrid; USD 140,000 - 200,000; Full time

Job summary

The Intersect Group is seeking a Principal Data Engineer in Atlanta, GA, with a strong focus on building scalable data platforms and products for analytics, ML/AI, and reporting. Hybrid work is available and you will partner with multiple teams to shape data architecture and governance.

You will lead the design and delivery of lakehouse, data warehouse, and semantic layers, while driving CI/CD and modern DevOps practices across the data stack.

Qualifications

• Deep expertise in Python, SQL, PySpark and/or Scala and distributed data processing frameworks.

Responsibilities

• Define and evolve enterprise data engineering architectures, design patterns, standards, and best practices.
• Create reusable engineering frameworks, templates, automation standards, and playbooks.

Skills

Python

SQL

PySpark

Scala

Azure

Databricks

Delta Lake

CI/CD

Docker

Kubernetes

Infrastructure as Code

DevOps

Observability

Data Governance

Tools

Azure Databricks

Delta Lake

Docker

Kubernetes

Terraform

Job description

The Intersect Group is seeking a Principal Data Engineer in Atlanta, GA, with a strong focus on building scalable data platforms and products for analytics, ML/AI, and reporting. Hybrid work is available and you will partner with multiple teams to shape data architecture and governance.

You will lead the design and delivery of lakehouse, data warehouse, and semantic layers, while driving CI/CD and modern DevOps practices across the data stack.