Senior Data Engineer: Data Pipelines & Analytics

The Home Depot; Atlanta (GA); Remote; USD 120,000 - 180,000; Full time

Job summary

The Home Depot is seeking a Senior Data Engineer in Atlanta to design and maintain scalable data pipelines, validate data quality, and enable data-driven decisions across teams. You will build APIs, host enterprise solutions, and apply big-data techniques to cleanse and transform data while ensuring data integrity.

You will collaborate with business partners, develop and test ETL jobs, and mentor junior engineers to promote best practices in data engineering.

Qualifications

• Bachelor’s degree in a quantitative field or equivalent.
• 5+ years of relevant work experience.
• Experience in predictive modeling, data mining and data analysis.
• Experience developing and testing ETL jobs/pipelines, configuring orchestration, automated CI/CD, writing automation scripts, and supporting the pipelines in production.
• Experience in high-level programming languages such as Python.
• Experience defining and capturing metadata and rules associated with ETL processes.
• Experience building Batch and Streaming pipelines.
• Proven ability to stitch data from multiple sources.
• Ability to code in Python, Google BigQuery to stitch and enrich data from multiple sources.
• Proven ability to use PySpark, AirFlow, and DataProc to engineer and automate data flows pipelines.
• Ability to optimize the pipelines run time and lower the cost on slots/storage consumption.
• Ability to prioritize requests and manage a product roadmap.
• Coaching junior engineers to improve code and best practices.
• Strong verbal and written communications skills at all levels.

Responsibilities

• Collaborate with internal customers and cross-functional teams to translate business requirements into data solutions.
• Guide project teams through design and development of complex data applications.
• Develop, test, and maintain data pipelines and architectures with a focus on reliability and performance.
• Communicate insights and recommendations to technical and non-technical stakeholders.
• Mentor junior engineers and participate in recruitment and workload planning.

Skills

Strong verbal and written comms

Prioritize requests and manage roadmap

Data storytelling

Cross-functional collaboration

Education

Bachelor's degree or equivalent in a quantitative field

Master's degree preferred

Tools

Python

SQL

PySpark

Airflow

DataProc

Google BigQuery

CI/CD

ETL pipelines

Batch & Streaming pipelines

JavaScript

React

Job description

The Home Depot is seeking a Senior Data Engineer in Atlanta to design and maintain scalable data pipelines, validate data quality, and enable data-driven decisions across teams. You will build APIs, host enterprise solutions, and apply big-data techniques to cleanse and transform data while ensuring data integrity.

You will collaborate with business partners, develop and test ETL jobs, and mentor junior engineers to promote best practices in data engineering.