Sr. Data Engineer

Totalwine; Maryland; On-site; USD 122,000 - 165,000; Full time

Benefits offered by this job

PTO

Store discounts

Health care plans

401(k) / HSA / FSA

Life insurance

Job summary

Total Wine & More in Bethesda, MD is seeking a Senior Data Engineer to join our Technology team. You will design and operate pipelines, platforms, and frameworks delivering reliable data to analytics engineers, analysts, and business users across merchandising, supply chain, marketing, and e-commerce.

You will build scalable batch and streaming pipelines, optimize ELT/ETL workflows, and own data infrastructure reliability, performance, and cost.

Qualifications

• Bachelor's degree in Computer Science, Statistics, Engineering or equivalent experience.
• 3–6 years of data engineering experience building and operating production pipelines.
• Expert-level SQL and Python with Spark or similar distributed frameworks.
• Cloud data platforms (BigQuery, Microsoft Fabric, Snowflake, Databricks) and lakehouse architectures (Delta Lake, Parquet).
• Experience with streaming/event-driven architectures (Kafka, Pub/Sub) and real-time or micro-batch ingestion.
• Strong version control, CI/CD, and data testing/observability (e.g., Great Expectations, dbt tests).
• Understanding of data warehousing, dimensional modeling, and ETL/ELT best practices.
• Excellent communication and cross-functional collaboration in a large organization.
• Familiarity with BI/analytics tools (Power BI, dbt) is a plus.

Responsibilities

• Design, build, and maintain scalable batch and streaming data pipelines ingesting data from internal systems, third-party platforms, and APIs.
• Develop and optimize ELT/ETL workflows using orchestration/processing tools (Spark, Airflow, notebooks) across cloud platforms.
• Own reliability, performance, and cost-efficiency of data infrastructure with monitoring and capacity planning.
• Implement data quality, observability, and lineage to ensure trusted data across domains (sales, inventory, loyalty).
• Collaborate with analytics engineers, BI developers, and stakeholders to deliver analytics-ready datasets into warehouse/lakehouse layers.
• Establish and promote engineering best practices: version control, CI/CD, automated testing, IaC.
• Contribute to platform architecture decisions, tooling evaluations, and documentation to raise engineering standards.

Skills

SQL

Python

Spark

Education

Bachelor's degree in Computer Science

Tools

Airflow

dbt

Great Expectations

Kafka

Pub/Sub

Git

Job description

About the Role

Total Wine & More is seeking a Senior Data Engineer to join our Technology team in our Bethesda, MD office. This role will be part of our enterprise data team and play a pivotal role in building the data infrastructure that powers analytics across the organization. In this role, you will design and operate the pipelines, platforms, and frameworks that deliver reliable, timely, and high-quality data to analytics engineers, analysts, and business users across merchandising, supply chain, marketing, and e-commerce. You will report to the Sr. Director, BI & Data Platform.

You will

• Design, build, and maintain scalable, fault-tolerant batch and streaming data pipelines that ingest data from internal systems, third-party platforms, and APIs.
• Develop and optimize ELT/ETL workflows using modern orchestration and processing frameworks (e.g., Spark/PySpark, Airflow, or notebook-based pipelines) across cloud data platforms.
• Own the reliability, performance, and cost-efficiency of data infrastructure, including monitoring, alerting, and capacity planning.
• Implement data quality, observability, and lineage frameworks to ensure trusted data across multiple domains (e.g., sales, inventory, customer loyalty).
• Partner with analytics engineers, BI developers, and business stakeholders to deliver well-structured, analytics-ready datasets into the warehouse and lakehouse layers.
• Establish and champion engineering best practices, including version control, CI/CD, automated testing, and infrastructure-as-code.
• Contribute to platform architecture decisions, tooling evaluations, and documentation that raise the engineering bar across the team.

You will come with

• Bachelor'sDegree Computer Science, Statistics, Engineering preferred or equivalent years of experience
• 3-6 years of experience in data engineering, building and operating production data pipelines at scale. preferred
• Expert-level SQL and strong programming skills in Python, with hands-on experience in Spark or similar distributed processing frameworks.
• Deep experience with modern cloud data platforms (e.g., BigQuery, Microsoft Fabric, Snowflake, Databricks) and lakehouse architectures (e.g., Delta Lake, Parquet).
• Experience with streaming and event-driven architectures (e.g., Kafka, Pub/Sub) and real-time or micro-batch ingestion patterns.
• Strong command of version control (e.g., Git), CI/CD pipelines, and data testing/observability frameworks (e.g., Great Expectations, dbt tests).
• Solid understanding of data warehousing, dimensional modeling, and ETL/ELT best practices.
• Excellent communication skills and ability to work cross-functionally in a large, matrixed organization.
• Familiarity with BI and analytics tooling (e.g., Power BI, dbt) and how downstream consumers use engineered data is a plus.

We Offer

• Paid Time Off (PTO)
• Generous store discounts
• Health care plans (medical, prescription, dental, vision)
• 401(k), HSA, FSA, Pre-tax commuter benefits
• Disability and life insurance coverage
• Paid parental leave
• Pet insurance discounts
• Critical illness and accident insurance
• Discounted home and auto insurance
• College tuition assistance
• Career development, industry education
• Consumer classes
• & More!

Crafted for you

We recognize our team members are our biggest asset, and we value the critical role each play in contributing to the company’s success. It is our commitment to support and provide access to the resources needed to take care of their health and wellbeing. That is why we offer a variety of benefits, tools, and resources to support through our Total Rewards program.

Total Wine & More considers several factors when establishing compensation. Compensation may vary based on a number of factors including, but not limited to, market location, job-related knowledge, skills and/or experience. The actual hourly rate will equal or exceed the required minimum wage applicable to the job location. Estimated salaries determined by third parties have not been validated by Total Wine & More.

Total Wine & More is an equal opportunity employer and all qualified applicants will receive consideration for employment without discrimination based on race, color, religion, national origin, sex, sexual orientation, age, marital status, veteran status, disability, or any other characteristic protected by applicable law. Total Wine & More makes reasonable accommodations during all aspects of the employment process, including during the interview process. Total Wine & More is a Drug Free Workplace.

The information provided above indicates the general nature and level of work required of the position and is not a comprehensive list of all responsibilities or qualifications. Benefits list is only a highlight of some of the benefits offered to team members; eligibility for certain benefits apply. The anticipated close date of this posting is 120 days from the posted date indicated above.

Worker Type:

Regular

Pay Range:

$122,200.00 - $165,000.00 Annual