Principal Data Engineer - Data Architecture & Pipelines

Dollar General; Nashville (TN); On-site; USD 120,000 - 160,000; Full time

Job summary

Dollar General in Nashville, TN is seeking a Principal Data Engineer to lead data architecture, build scalable data pipelines, and optimize data delivery for multiple teams. The role emphasizes partnering with data scientists, engineers, and business analysts to enable reliable data infrastructure.

The ideal candidate will have extensive experience in data systems from the ground up, strong cloud experience (GCP/Snowflake/Azure), and a track record of delivering high-performance data platforms

Qualifications

• H hands-on programming with Python/SQL/GoLang.
• SQL DB design concepts & data models.
• Strong numerical and analytical skills.
• Degree in Computer Science or IT; Master’s preferred.
• Data engineering certification is a plus.
• Experience with Hadoop, Spark, Kafka.
• Experience with MongoDB, PostgreSQL, Cassandra.
• Experience with Airflow, Dataflow, Composer.
• Experience with GCP, Snowflake, Azure; BigQuery/Redshift.
• Experience with stream processing: Kafka, Spark Streaming.
• Knowledge of software engineering principles.
• Multitasking and shifting priorities.
• BI tools for data analysis and QA.

Responsibilities

• Develop, construct, test, and maintain data architectures and pipelines.
• Collaborate with data scientists and stakeholders.
• Assemble large, complex data sets to meet business requirements.
• Build analytics tools using the data pipeline for insights.
• Maintain data security and compliance.
• Identify and implement internal process improvements.
• Keep up-to-date with latest technology trends.

Skills

Python

SQL

GoLang

Big data tooling

Data modeling

Java

Spark

Kafka

Airflow

GCP

Snowflake

Azure

Databricks

NoSQL

BI Tools

Education

9+ years IT/CS experience

BS/MS in CS or related field

4+ years Python or Java dev

4+ years SQL experience

4+ years schema design and dimensional modeling

Cloud platforms (Snowflake/Azure/Databricks)

Tools

Hadoop

Spark

Kafka

Airflow

Dataflow

Composer

GCP

Snowflake

Azure

BigQuery

Redshift

MongoDB

PostgreSQL

Cassandra

Job description

Dollar General in Nashville, TN is seeking a Principal Data Engineer to lead data architecture, build scalable data pipelines, and optimize data delivery for multiple teams. The role emphasizes partnering with data scientists, engineers, and business analysts to enable reliable data infrastructure.

The ideal candidate will have extensive experience in data systems from the ground up, strong cloud experience (GCP/Snowflake/Azure), and a track record of delivering high-performance data platforms