BI Data Engineer II

Hcrb; Boston (MA); On-site; USD 77,000 - 136,000; Full time

Benefits offered by this job

Tuition reimbursement

Fertility/adoption support

Free financial coaching

Health & wellness program

Professional development

Free beer!

Job summary

Boston Beer Company is hiring a Full-Time BI Data Engineer II in Boston, MA. The chosen candidate will play a key role in building our Enterprise Data Platform, utilizing a Databricks-first approach to support scalable data pipelines and analytics-ready datasets.

The role involves working closely with cross-functional teams and translating requirements into maintainable data solutions while ensuring data quality and governance across Databricks.

Qualifications

• Hands-on experience developing data pipelines in Databricks using notebooks, jobs, and workflows.
• Strong SQL and Python skills with the ability to troubleshoot data issues.
• Working knowledge of Lakehouse architecture and Delta tables.

Responsibilities

• Design, build, test, and support Databricks Lakehouse data pipelines.
• Monitor, troubleshoot, and optimize Spark jobs for performance.
• Implement data validation, error handling, and governance standards.

Skills

Databricks & Spark

SQL & Python

Lakehouse Concepts

Data Quality & Governance

CI/CD & Automation

Collaboration & Problem-Solving

Education

Bachelor’s degree in Computer Science or equivalent

Tools

Azure DevOps

Databricks Notebooks

Power BI

Jira

Confluence

Job description

We are currently hiring a Full-Time BI Data Engineer II in Boston, MA.

Join our Boston-based Data and Analytics (DnA) team and play a key role in building and evolving our Enterprise Data Platform with a Databricks-first approach. This position will support the development of scalable Lakehouse data pipelines, curated data assets, and analytics-ready datasets that strengthen business decision-making across the organization. As a hands-on Data Engineer II, you will contribute across the data engineering lifecycle—from requirements gathering and solution design through development, testing, deployment, monitoring, and production support. You will work primarily in Databricks using Spark, Delta Lake, Python, and SQL, while also supporting integrations with our On-Premise SQL data warehouse as we continue modernizing the platform.

We are moving toward a domain-oriented team model, and this position will be primarily assigned to one or more business areas to be determined. This gives the engineer the opportunity to build deeper business context while applying modern Databricks patterns such as bronze, silver, and gold layers, reusable transformation logic, data quality controls, and governed data products for enterprise reporting and analytics.

This is a strong opportunity for someone with solid data engineering fundamentals who wants to grow deeper in Databricks, Spark, Delta Lake, Python, SQL, and cloud-based data integrations while helping modernize an enterprise data platform. The engineer will help build reliable, production-ready pipelines, improve data quality and governance, and support the transition from legacy SQL-based processes toward a scalable Lakehouse architecture in a collaborative, fast-paced environment.

What You’ll Brew:

• Design, build, test, and support Databricks Lakehouse data pipelines using Spark, Delta Lake, Python, and SQL for reporting, analytics, and downstream business use cases.

• Develop and maintain Databricks notebooks, workflows, jobs, and reusable pipeline components following team standards for version control, documentation, testing, and deployment.

• Build and maintain curated datasets and analytics-ready models across Lakehouse layers, including bronze, silver, and gold, with attention to data quality, lineage, and business usability.

• Support data ingestion, migration, and integration between Databricks, On-Premise SQL Server, SaaS platforms, and other enterprise systems as part of platform modernization.

• Partner with analysts, data scientists, business stakeholders, and teams across the Data Enterprise organization, including Data Operations and MDM, to translate requirements into scalable and maintainable data solutions.

• Monitor, troubleshoot, and optimize Spark jobs and Databricks workflows for performance, reliability, and cost efficiency under established engineering best practices.

• Implement data validation, error handling, data quality checks, security practices, and governance standards across Databricks.

• Maintain, administer, and support the evolution of our Databricks platform as a shared responsibility with other team members.

• Support CI/CD and automated deployment practices, including Azure DevOps and Databricks Asset Bundles where applicable, to improve repeatability and production readiness.

What Ingredients You’ll Bring:

Minimum Qualifications:

• Bachelor’s degree in Computer Science, a closely related field, or equivalent experience.

• Databricks & Spark: Hands-on experience developing data pipelines in Databricks using notebooks, jobs, workflows, PySpark or Spark SQL, and Delta Lake.

• Programming & SQL: Strong SQL and Python skills, with the ability to write maintainable transformation logic, troubleshoot data issues, and support production pipelines.

• Lakehouse Concepts: Working knowledge of Lakehouse architecture, Delta tables, medallion-style layers, batch processing, and analytics-ready data modeling.

• Databricks Platform Exposure: Exposure to one or more Databricks platform capabilities such as Unity Catalog, Delta Live Tables, Databricks SQL, job clusters, workflow orchestration, performance tuning, cluster configuration, administration, or resource provisioning.

• Data Quality & Governance: Ability to apply data validation, reconciliation, access controls, documentation, and governance practices to support trusted enterprise data products.

• CI/CD & Automation: Exposure to source control and automated deployment practices using tools such as Azure DevOps and Databricks Asset Bundles for reliable, production-ready workflows.

• Collaboration & Problem-Solving: Ability to work effectively with analysts, stakeholders, and cross-functional teams to troubleshoot and optimize pipelines.

• AI & Analytics: Exposure to AI, machine learning, feature engineering, or analytics frameworks within a modern data platform is a plus.

Preferred Qualifications:

• Data Modeling & BI: Familiarity with dimensional modeling, semantic layers, and Power BI for building analytics-ready datasets.

• ETL/ELT & SQL Server: Experience designing, developing, and supporting relational database pipelines, stored procedures, or SSIS workflows.

• Domain & Systems Knowledge: Knowledge of CPG, consumer insights and analytics tools such as Nielsen, supply chain processes, Salesforce, SAP, or other enterprise systems is a plus.

• Collaboration & Project Tools: Experience with Jira and Confluence for project tracking, documentation, and team collaboration.

• Scripting: PowerShell or automation scripting experience is a plus.

Level: 7

At the Boston Beer Company and in accordance with pay transparency laws, we are open about our salary ranges. For this role, the salary range is between $77,000 and $136,000. However, it’s important to note that where the person hired starts in this range is dependent on their related experience, skillset and location. Additionally, this position qualifies for a discretionary annual bonus based on company and individual performance, and certain sales roles might include a car allowance.

Some Perks:

Our people are our most important “ingredient.” We hire the best talent; and we reward, develop, and retain them too.

In addition to generous healthcare on day one, stock purchase plan, 401k and more, Full Time Boston Beer Coworkers have the following perks available*:

• Tuition reimbursement
• Fertility/adoption support
• Free financial coaching
• Health & wellness program and discounts
• Professional development & training
• Free beer!

*Talk to your recruiter about eligibility

The Boston Beer Company may use AI-enabled tools to assist with identifying qualified candidates and streamline recruiting operations. These tools help us improve efficiency and consistency. All hiring decisions are made thoughtfully by recruiters and hiring teams. We regularly evaluate our processes to promote fairness, reduce bias, and comply with applicable laws.

To ensure the integrity of the evaluation, please refrain from using AI-generated enhancements during your phone and virtual interviews. If we discover that you have used such enhancements without authorization or prior disclosure, you may be disqualified from the hiring process. External AI tools may not be used to transcribe or record the interview at any time. This ensures your privacy, and Boston Beer's confidential information are protected.

Qualified applicants with arrest or conviction records will be considered for employment in accordance with the Fair Chance Ordinance and the CA Fair Chance Act.

Boston Beer Corporation is an equal opportunity employer and is committed to a diverse workforce. In order to help ensure reasonable accommodation for individuals protected by Section 503 of the Rehabilitation Act of 1973, the Vietnam Veteran’s Readjustment Act of 1974, and Title I of the Americans with Disabilities Act of 1990, applicants who wish to request accommodation in the job application process can contact [e-mail] for assistance.