Sr Data Engineer - Assortment and Space Planning

The Home Depot, Inc.; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

The Home Depot, Inc. seeks a Sr Data Engineer to expand and optimize data pipelines, data flow, and data collection for cross-functional teams.

The role supports software engineers, data analysts and data scientists to ensure consistent data delivery across projects, while redesigning data architecture to enable future products and initiatives. Responsibilities include ETL development, data infrastructure maintenance, and architecture design, working with multiple teams to meet business

Qualifications

• Experience with message queuing, stream processing, and scalable data stores.
• Experience with SQL/NoSQL databases and query authoring.
• Experience building and optimizing data pipelines and architectures.
• Experience working with cross-functional teams.

Responsibilities

• Develop and validate ETL processes to ensure data integration.
• Maintain data infrastructure performance and integrity.
• Design and analyze data pipeline architecture to meet business needs.
• Collaborate with team leads to assess requirements and opportunities.

Skills

Message Queuing

Stream Processing

SQL

NoSQL

Relational Databases

Python

Java

C#

Scala

Go

Airflow

Azkaban

Luigi

Root Cause Analysis

Data Pipelines

Data Architecture

Education

Bachelor's degree

Tools

Airflow

Azkaban

Luigi

Job description

Position Purpose:

The Sr Data Engineer will expand and optimize data, data flow, data collection for cross functional teams, and data pipeline architecture. The Sr Data Engineer will support and collaborate with the software engineering team, data analysts, and data scientist to ensure data delivery architecture is consistent throughout ongoing projects. Continuously improve or re-design data architecture to support the next generation of products and initiatives.

Key Responsibilities:

• 40% Data Validation, ETL, Infrastructure Development: Coding validation and ETL to ensure successful data integration

• 30% Data Infrastructure Maintenance: Backup and optimization activities to maintain performance; code, configure, test, etc data to ensure integrity

• 20% Data Architecture Design and Analysis: Create and maintain optimal data pipeline architecture; Develop data architecture to meet business requirements

• 10% Planning/Requirements Analysis: Collaborate with team leads and cross functional partners to assess business requirements and communicate opportunities

Direct Manager/Direct Reports:

• This position reports to the Technology Leader.

• This position has 0 direct reports.

Travel Requirements:

• Typically requires overnight travel less than 10% of the time.

Physical Requirements:

• Most of the time is spent sitting in a comfortable position and there is frequent opportunity to move about. On rare occasions there may be a need to move or lift light articles.

Working Conditions:

• Located in a comfortable indoor area. Any unpleasant conditions would be infrequent and not objectionable.

Minimum Qualifications:

• Must be eighteen years of age or older.

• Must be legally permitted to work in the United States.

• Experience message queuing, stream processing, and scalable data stores

• Experience managing projects and organizing data

• Experience supporting and working with cross-functional teams

• Experience with SQL, NoSQL databases, relational databases, and query authoring

• Experience building and optimizing data pipelines, architectures, data sets and workflow management tools such as Azkaban, Luigi, Airflow, etc.

• Experience with object-oriented/object function scripting languages: Python, Java, C#, Scala, GoLang, etc.

• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement

Preferred Qualifications:

• 8+ years of previous related work experience

• Ability to convey complex or technical ideas and processes in easy-to-understand terms to diverse audiences

• Ability to negotiate, handle complaints, settle disputes, and resolve grievances with both internal and external customers

• Excellent written and verbal communication skills

Minimum Education:

• The knowledge, skills and abilities typically acquired through the completion of a bachelor's degree program or equivalent degree in a field of study related to the job.

Preferred Education:

• No additional education

Minimum Years of Work Experience:

• 5

Preferred Years of Work Experience:

• No additional years of experience

Minimum Leadership Experience:

• None

Preferred Leadership Experience:

• None

Certifications:

• None

Competencies:

• Collaborates - Building partnerships and working collaboratively with others to meet shared objectives

• Communicates Effectively - Developing and delivering multi-mode communications that convey a clear understanding of the unique needs of different audiences

• Cultivates Innovation - Creating new and better ways for the organization to be successful

• Drives Engagement - Creating a climate where people are motivated to do their best to help the organization achieve its objectives

• Instills Trust - Gaining the confidence and trust of others through honesty, integrity, and authenticity

• Nimble Learning - Actively learning through experimentation when tackling new problems, using both successes and failures as learning fodder

• Optimizes Work Processes - Knowing the most effective and efficient processes to get things done with a focus on continuous improvement

• Plans and Aligns - Planning and prioritizing work to meet commitments aligned with organizational goals

• Tech Savvy - Anticipating and adopting innovations in business-building digital and technology applications.

We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class.