Senior Data Engineer: Build Scalable Data Pipelines

Totalwine; Maryland; On-site; USD 122,000 - 165,000; Full time

Benefits offered by this job

PTO

Store discounts

Health care plans

401(k) / HSA / FSA

Life insurance

Job summary

Total Wine & More in Bethesda, MD is seeking a Senior Data Engineer to join our Technology team. You will design and operate pipelines, platforms, and frameworks delivering reliable data to analytics engineers, analysts, and business users across merchandising, supply chain, marketing, and e-commerce.

You will build scalable batch and streaming pipelines, optimize ELT/ETL workflows, and own data infrastructure reliability, performance, and cost.

Qualifications

• Bachelor's degree in Computer Science, Statistics, Engineering or equivalent experience.
• 3–6 years of data engineering experience building and operating production pipelines.
• Expert-level SQL and Python with Spark or similar distributed frameworks.
• Cloud data platforms (BigQuery, Microsoft Fabric, Snowflake, Databricks) and lakehouse architectures (Delta Lake, Parquet).
• Experience with streaming/event-driven architectures (Kafka, Pub/Sub) and real-time or micro-batch ingestion.
• Strong version control, CI/CD, and data testing/observability (e.g., Great Expectations, dbt tests).
• Understanding of data warehousing, dimensional modeling, and ETL/ELT best practices.
• Excellent communication and cross-functional collaboration in a large organization.
• Familiarity with BI/analytics tools (Power BI, dbt) is a plus.

Responsibilities

• Design, build, and maintain scalable batch and streaming data pipelines ingesting data from internal systems, third-party platforms, and APIs.
• Develop and optimize ELT/ETL workflows using orchestration/processing tools (Spark, Airflow, notebooks) across cloud platforms.
• Own reliability, performance, and cost-efficiency of data infrastructure with monitoring and capacity planning.
• Implement data quality, observability, and lineage to ensure trusted data across domains (sales, inventory, loyalty).
• Collaborate with analytics engineers, BI developers, and stakeholders to deliver analytics-ready datasets into warehouse/lakehouse layers.
• Establish and promote engineering best practices: version control, CI/CD, automated testing, IaC.
• Contribute to platform architecture decisions, tooling evaluations, and documentation to raise engineering standards.

Skills

SQL

Python

Spark

Education

Bachelor's degree in Computer Science

Tools

Airflow

dbt

Great Expectations

Kafka

Pub/Sub

Git

Job description

Total Wine & More in Bethesda, MD is seeking a Senior Data Engineer to join our Technology team. You will design and operate pipelines, platforms, and frameworks delivering reliable data to analytics engineers, analysts, and business users across merchandising, supply chain, marketing, and e-commerce.

You will build scalable batch and streaming pipelines, optimize ELT/ETL workflows, and own data infrastructure reliability, performance, and cost.