Online Data Engineer: ETL, Data Lakes & APIs

The Home Depot; Atlanta (GA); On-site; USD 110,000 - 150,000; Full time

Job summary

The Home Depot is seeking an Online Data Engineer to design, build, and maintain data pipelines that capture and transform customer data into actionable insights. You will work with large datasets, develop data validation methods, and create APIs to access data.

As part of a team focused on in-house enterprise solutions, you will apply data extraction, transformation, and loading techniques to connect diverse sources, validate data, and enable reliable analytics.

Qualifications

• Bachelor's or Master's degree in a quantitative field or equivalent work experience.
• Experience developing and testing ETL jobs/pipelines, configuring orchestration, automated CI/CD, writing automation scripts, and supporting the pipelines in production.
• Experience in high-level programming languages such as Python
• Experience defining and capturing metadata and rules associated with ETL processes
• Experience building Batch and Streaming pipelines
• Experience writing analytical SQL queries
• Ability to stitch and maintain data from multiple sources
• Ability to use JavaScript, Front-end development frameworks (React, Nucleus), and QA apps (Retina, KPI Shield, Alert Goose)
• Ability to produce tags for site data
• Ability to code in Python, Google BigQuery to stitch and enrich the raw data from multiple sources
• Ability to use PySpark, AirFlow, and DataProc to engineer and automate data flows pipelines
• Ability to optimize the pipelines run time and lower the cost on slots/storage consumption
• Ability to prioritize requests and manage a product roadmap
• Strong verbal and written communications skills at all levels

Responsibilities

• 10% - Business Collaboration to translate requirements and collaborate with internal customers.
• 20% - Project management & team support; present insights to leaders and partners and prepare progress reports.
• 55% - Solution development; design and implement algorithms on large datasets and lead analytics projects.
• 15% - Technical exploration and development; pursue new analytics developments and replicable solutions.

Skills

Python

SQL

ETL pipelines

Data analytics

Cross-functional collaboration

Communication

Education

Bachelor's degree in a quantitative field

Master's degree in a quantitative field

Tools

Google BigQuery

PySpark

Airflow

Dataproc

Job description

The Home Depot is seeking an Online Data Engineer to design, build, and maintain data pipelines that capture and transform customer data into actionable insights. You will work with large datasets, develop data validation methods, and create APIs to access data.

As part of a team focused on in-house enterprise solutions, you will apply data extraction, transformation, and loading techniques to connect diverse sources, validate data, and enable reliable analytics.