Sr. Data Engineer

Total Wine & More; Bethesda (MD); On-site; USD 130,000 - 170,000; Full time

Benefits offered by this job

Paid Time Off (PTO)

Health care plans

401(k)

HSA & FSA

Parental leave

Disability and life insurance

Job summary

Total Wine & More in Bethesda, MD is seeking a Senior Data Engineer to design and operate scalable data pipelines. You will own ELT/ETL workflows, ensure data quality, governance, and observability, and collaborate with analytics teams to deliver analytics-ready datasets across merchandising, supply chain, marketing, and ecommerce.

You will work with Spark/PySpark, Airflow, and modern cloud data platforms to optimize performance and costs, while upholding engineering best practices and CI/CD.

Qualifications

• Bachelor's degree in Computer Science, Statistics, Engineering or equivalent
• 3-6 years of data engineering experience
• Expert-level SQL and strong Python with Spark or similar distributed processing
• Experience with cloud data platforms (BigQuery, Snowflake, Databricks) and lakehouse architectures
• Experience with streaming/event-driven architectures (Kafka, Pub/Sub)
• Knowledge of CI/CD, version control, testing, and observability tools
• Excellent communication and cross-functional collaboration

Responsibilities

• Design, build, and maintain scalable data pipelines ingesting data from internal systems and third-party sources
• Develop and optimize ELT/ETL workflows using Spark/PySpark, Airflow, or notebook-based pipelines
• Own reliability, performance, cost-efficiency, monitoring, alerting, and capacity planning of data infrastructure
• Implement data quality, observability, and lineage across domains (sales, inventory, loyalty)
• Collaborate with analytics engineers, BI developers, and stakeholders to deliver analytics-ready datasets
• Contribute to platform architecture decisions, tooling evaluations, and documentation

Skills

SQL

Python

Spark

Data quality

Communication

CI/CD

Education

Bachelor's degree in Computer Science, Statistics, Engineering

Tools

Airflow

dbt

Great Expectations

Kafka

Git

Power BI

Delta Lake

Job description

About The Role

Total Wine & More is seeking a Senior Data Engineer to join our Technology team in our Bethesda, MD office. This role will be part of our enterprise data team and play a pivotal role in building the data infrastructure that powers analytics across the organization. In this role, you will design and operate the pipelines, platforms, and frameworks that deliver reliable, timely, and high-quality data to analytics engineers, analysts, and business users across merchandising, supply chain, marketing, and e-commerce. You will report to the Sr. Director, BI & Data Platform.

You will

• Design, build, and maintain scalable, fault-tolerant batch and streaming data pipelines that ingest data from internal systems, third-party platforms, and APIs.
• Develop and optimize ELT/ETL workflows using modern orchestration and processing frameworks (e.g., Spark/PySpark, Airflow, or notebook-based pipelines) across cloud data platforms.
• Own the reliability, performance, and cost-efficiency of data infrastructure, including monitoring, alerting, and capacity planning.
• Implement data quality, observability, and lineage frameworks to ensure trusted data across multiple domains (e.g., sales, inventory, customer loyalty).
• Partner with analytics engineers, BI developers, and business stakeholders to deliver well-structured, analytics-ready datasets into the warehouse and lakehouse layers.
• Establish and champion engineering best practices, including version control, CI/CD, automated testing, and infrastructure-as-code.
• Contribute to platform architecture decisions, tooling evaluations, and documentation that raise the engineering bar across the team.

You will come with

• Bachelor'sDegree Computer Science, Statistics, Engineering preferred or equivalent years of experience
• 3-6 years of experience in data engineering, building and operating production data pipelines at scale. preferred
• Expert-level SQL and strong programming skills in Python, with hands-on experience in Spark or similar distributed processing frameworks.
• Deep experience with modern cloud data platforms (e.g., BigQuery, Microsoft Fabric, Snowflake, Databricks) and lakehouse architectures (e.g., Delta Lake, Parquet).
• Experience with streaming and event-driven architectures (e.g., Kafka, Pub/Sub) and real-time or micro-batch ingestion patterns.
• Strong command of version control (e.g., Git), CI/CD pipelines, and data testing/observability frameworks (e.g., Great Expectations, dbt tests).
• Solid understanding of data warehousing, dimensional modeling, and ETL/ELT best practices.
• Excellent communication skills and ability to work cross-functionally in a large, matrixed organization.
• Familiarity with BI and analytics tooling (e.g., Power BI, dbt) and how downstream consumers use engineered data is a plus.

We Offer

• Paid Time Off (PTO)
• Generous store discounts
• Health care plans (medical, prescription, dental, vision)
• 401(k), HSA, FSA, Pre-tax commuter benefits
• Disability and life insurance coverage
• Paid parental leave
• Pet insurance discounts
• Critical illness and accident insurance
• Discounted home and auto insurance
• College tuition assistance
• Career development, industry education
• Consumer classes
• & More!

Crafted for you

We recognize our team members are our biggest asset, and we value the critical role each play in contributing to the company’s success. It is our commitment to support and provide access to the resources needed to take care of their health and wellbeing. That is why we offer a variety of benefits, tools, and resources to support through our Total Rewards program.

Total Wine & More considers several factors when establishing compensation. Compensation may vary based on a number of factors including, but not limited to, market location, job-related knowledge, skills and/or experience. The actual hourly rate will equal or exceed the required minimum wage applicable to the job location. Estimated salaries determined by third parties have not been validated by Total Wine & More.

Total Wine & More is an equal opportunity employer and all qualified applicants will receive consideration for employment without discrimination based on race, color, religion, national origin, sex, sexual orientation, age, marital status, veteran status, disability, or any other characteristic protected by applicable law. Total Wine & More makes reasonable accommodations during all aspects of the employment process, including during the interview process. Total Wine & More is a Drug Free Workplace.

The information provided above indicates the general nature and level of work required of the position and is not a comprehensive list of all responsibilities or qualifications. Benefits list is only a highlight of some of the benefits offered to team members; eligibility for certain benefits apply.

The anticipated close date of this posting is 120 days from the posted date indicated above.