Senior Data Engineer

Grainger Management LLC; Lake Forest (IL); Hybride; USD 105 000 - 174 000; Plein temps

Avantages offerts par ce poste

Medical, dental, vision, and life ins.

Therapy sessions (6 per year)

18 days PTO

6 company holidays

6% 401(k) company match

Employee discounts

Tuition reimbursement

Student loan refinancing

Financial counseling tools

Maternity & parental leave

Résumé du poste

Grainger is hiring a Senior Data Engineer to design and operate governed batch and real-time data products for Product Discovery, supporting search, ML, analytics, and AI-enabled experiences. You will build pipelines, data assets, and orchestration patterns, making trusted data available to search, ML, analytics, and engineering teams.

The role requires 3+ years in data or software engineering, strong Python/Spark skills, and experience with CDC, streaming, and CI/CD on AWS or similar cloud

Qualifications

• Bachelor's degree in a technical field or equivalent experience
• 3+ years of data engineering or software engineering experience
• Experience building production batch and streaming pipelines on modern data platforms
• Strong Python and Spark skills
• Experience with CDC, streaming architectures, and workflow orchestration
• Containerization and orchestration with Docker/Kubernetes on AWS
• CI/CD with GitHub Actions and automated testing
• Experience with relational, NoSQL, vector, or graph databases
• Ability to translate requirements into technical designs and solutions
• Knowledge of modern data engineering practices

Responsabilités

• Design and operate reliable, governed batch and real-time data products
• Build pipelines and data assets for search, ML, analytics, and engineering teams
• Develop scalable data solutions to integrate and transform data
• Apply data engineering practices to improve performance and reliability
• Partner with stakeholders to translate requirements into data solutions
• Develop scalable data pipelines integrating multiple sources
• Deliver reliable data for analytical and business needs
• Define reusable data engineering patterns for CDC and streaming workloads
• Provide guidance and establish engineering practices for less-experienced team members
• Collaborate on architecture, roadmap, and ownership of data capabilities

Connaissances

Databricks

Python

Spark

Kubernetes

AWS

CI/CD

Streaming

ETL

NoSQL/SQL

Formation

Bachelor's Degree

Outils

Databricks

Snowflake

Airflow

Tableflow

GitHub Actions

Debezium

Docker

AWS

DMS

Description du poste

Grainger is hiring a Senior Data Engineer to design and operate governed batch and real-time data products for Product Discovery, supporting search, machine learning, analytics, and AI-enabled experiences.

Responsibilities

• Design and operate reliable, governed batch and real-time data products using Databricks, Snowflake, Spark, Kubernetes, vector/search technologies, and cloud-native services
• Build pipelines, data assets, orchestration patterns, and search and retrieval capabilities that make trusted data available to search, machine learning, analytics, and engineering teams
• Design, develop, and maintain scalable data solutions to integrate and transform data for business and analytical use
• Apply data engineering practices to deliver reliable, high-quality data products while improving performance, scalability, and automation
• Partner with technical and business stakeholders to translate requirements into effective data solutions
• Design, develop, test, and maintain scalable data pipelines and data products integrating information from multiple sources
• Extract, transform, integrate, and deliver reliable data for analytical and business needs
• Develop and enhance data engineering capabilities to improve data accessibility, performance, quality, and scalability
• Analyze business and technical needs and translate them into data designs, specifications, and solutions
• Identify and implement improvements to data engineering processes, including automation, optimization, and increased reliability
• Resolve data-related challenges with stakeholders and deliver solutions aligned to business requirements
• Provide technical guidance, review designs, and help establish engineering practices for less-experienced team members
• Design and deliver scalable batch and streaming data pipelines and data products across modern data and cloud platforms
• Define reusable Data Engineering patterns for CDC, event-driven processing, workflow orchestration, data products, and AI/search-enabled workloads
• Partner with Engineering, Product, and Applied Science on architecture, roadmap, adoption, and operational ownership of data capabilities

Requirements

• Bachelor's Degree or equivalent experience in Computer Science, Computer Engineering, Information Systems, Data Science, Software Engineering, or a related technical field
• 3+ years of related data engineering or software engineering experience
• Experience building and operating production batch and streaming data pipelines on Databricks or similar modern data platforms
• Strong software engineering skills in Python, with hands-on experience using Spark or other distributed processing frameworks
• Hands-on experience with CDC, streaming/event-driven architectures, and workflow orchestration, including selecting patterns based on scale, reliability, and use case
• Experience with containerization and orchestration such as Docker and Kubernetes, plus cloud platforms such as AWS or equivalent
• Experience implementing CI/CD and automated testing using GitHub Actions or equivalent platforms
• Experience working across relational, NoSQL, vector, graph, or other database technologies and choosing storage patterns based on the use case
• Experience designing and developing scalable data pipelines, data integration solutions, and data products
• Proficiency with programming, scripting, and data query languages used to develop and manipulate data solutions
• Experience translating requirements into technical designs and implementing solutions involving multiple data sources
• Knowledge of modern data engineering

Technologies

• Databricks, Snowflake, Spark, Kubernetes
• Vector/search technologies
• Python
• Docker, AWS
• GitHub Actions
• CDC, streaming/event-driven architectures, workflow orchestration
• CI/CD
• NoSQL, graph, relational, vector
• Tableflow, Airflow, Databricks Workflows
• AWS DMS, Debezium
• Machine learning, AI

Preferred

• Experience with CDC and orchestration platforms such as AWS DMS, Debezium, Tableflow, Airflow, Databricks Workflows, or equivalent technologies
• Experience using machine learning or AI within data pipelines to classify, enrich, standardize, match, or improve data
• Experience with e-commerce, search, recommendations, or personalization platforms
• Working knowledge of machine learning models and production of ML workflows

Compensation

• Anticipated base pay range: $104,500.00 - $174,200.00 per year
• Incentive target: eligible for up to 10% (or $), based on individual and company performance objectives per the incentive program terms (subject to change)

Benefits

• Medical, dental, vision, and life insurance plans with coverage starting on day one
• 6 free sessions each year with a licensed therapist for emotional wellbeing support
• 18 paid time off (PTO) days annually for full-time employees (accrual prorated based on employment start date)
• 6 company holidays per year
• 6% company contribution to a 401(k) Retirement Savings Plan each pay period; no employee contribution required
• Employee discounts, tuition reimbursement, student loan refinancing, and free access to financial counseling, education, and tools
• Maternity support programs, nursing benefits, and up to 14 weeks paid leave for birth parents and up to 4 weeks paid leave for non-birth parents

Location and Work Type

• Lake Forest, IL (Hybrid)

Sponsorship

• This position is not eligible for any form of sponsorship now or in the future
• Individuals requiring sponsorship (e.g., OPT or H1B) should not apply
• Only individuals authorized to work in the United States now and for the foreseeable future will be considered