Senior Data Engineer: Scalable Pipelines & Lakehouse

Total Wine & More; Bethesda (MD); On-site; USD 130,000 - 170,000; Full time

Benefits offered by this job

Paid Time Off (PTO)

Health care plans

401(k)

HSA & FSA

Parental leave

Disability and life insurance

Job summary

Total Wine & More in Bethesda, MD is seeking a Senior Data Engineer to design and operate scalable data pipelines. You will own ELT/ETL workflows, ensure data quality, governance, and observability, and collaborate with analytics teams to deliver analytics-ready datasets across merchandising, supply chain, marketing, and ecommerce.

You will work with Spark/PySpark, Airflow, and modern cloud data platforms to optimize performance and costs, while upholding engineering best practices and CI/CD.

Qualifications

• Bachelor's degree in Computer Science, Statistics, Engineering or equivalent
• 3-6 years of data engineering experience
• Expert-level SQL and strong Python with Spark or similar distributed processing
• Experience with cloud data platforms (BigQuery, Snowflake, Databricks) and lakehouse architectures
• Experience with streaming/event-driven architectures (Kafka, Pub/Sub)
• Knowledge of CI/CD, version control, testing, and observability tools
• Excellent communication and cross-functional collaboration

Responsibilities

• Design, build, and maintain scalable data pipelines ingesting data from internal systems and third-party sources
• Develop and optimize ELT/ETL workflows using Spark/PySpark, Airflow, or notebook-based pipelines
• Own reliability, performance, cost-efficiency, monitoring, alerting, and capacity planning of data infrastructure
• Implement data quality, observability, and lineage across domains (sales, inventory, loyalty)
• Collaborate with analytics engineers, BI developers, and stakeholders to deliver analytics-ready datasets
• Contribute to platform architecture decisions, tooling evaluations, and documentation

Skills

SQL

Python

Spark

Data quality

Communication

CI/CD

Education

Bachelor's degree in Computer Science, Statistics, Engineering

Tools

Airflow

dbt

Great Expectations

Kafka

Git

Power BI

Delta Lake

Job description

Total Wine & More in Bethesda, MD is seeking a Senior Data Engineer to design and operate scalable data pipelines. You will own ELT/ETL workflows, ensure data quality, governance, and observability, and collaborate with analytics teams to deliver analytics-ready datasets across merchandising, supply chain, marketing, and ecommerce.

You will work with Spark/PySpark, Airflow, and modern cloud data platforms to optimize performance and costs, while upholding engineering best practices and CI/CD.