Senior Data Engineer - Databricks Lakehouse Lead (Remote)

Buildertrend; Oregon; Hybrid; USD 130,000 - 160,000; Full time

Benefits offered by this job

Health coverage including medical, den

401(k) plan with company match

Generous PTO and holidays

Parental leave and sabbaticals

Volunteer time off

Wellness program and onsite fitness

Job summary

Buildertrend is seeking a Senior Data Engineer-Data Platform to lead a Databricks lakehouse migration, replacing legacy systems with a single trusted data source. You will design pipelines from Salesforce, SQL Server and Gong into analytics-ready datasets and collaborate with AI tools built on top of them.

You will champion medallion architecture, build robust ELT pipelines, refactor legacy pipelines, and improve reliability with automation and data quality checks.

Qualifications

• Bachelor's degree in computer science, software engineering, or related field.
• 5+ years of experience in data engineering, data science or data analytics.
• Hands-on, production-level experience with Databricks and Unity Catalog governance is required.
• Hands-on, production-level experience with dbt, including building and maintaining models, tests and macros in a real production environment is required.
• Experience leading a data platform migration from legacy systems to a modern lakehouse.

Responsibilities

• Design, build and maintain Buildertrend's Databricks lakehouse using a medallion architecture in dbt, setting layer standards and build rules.
• Build ELT pipelines with Databricks, dbt and Fivetran across SQL Server, Salesforce, MongoDB, Gong, OpenTelemetry, and vendors.
• Lead the exit from legacy systems by refactoring pipelines and repointing BI tools with clear ownership.
• Improve reliability via SQL Server log-ship replication, Fivetran ingestion, and automation like auto-recovery and full-refresh jobs.
• Build data quality checks, freshness monitoring and quality metrics using dbt tests, Unity Catalog and Fivetran metadata.
• Design access controls for large datasets, including per-team clusters and scope for AI tools to meet privacy requirements.
• Write data dictionaries, ERDs, specs, and column notes for human and AI consumption.
• Build and improve curated data products used by stakeholders and AI models.
• Partner with data science, ML and AI teams to curate datasets for model development and experiments, and with engineers and business leaders to prioritize work.
• Mentor engineers, contribute to architectural decisions and explore emerging tech to improve productivity.

Skills

Databricks

dbt

Fivetran

SQL

Python

Data modeling

ETL/ELT

Medallion architecture

Leadership

Mentoring

Education

Bachelor's degree in computer science or related field

Tools

Unity Catalog

Salesforce

SQL Server

MongoDB

OpenTelemetry

Tableau

Job description

Buildertrend is seeking a Senior Data Engineer-Data Platform to lead a Databricks lakehouse migration, replacing legacy systems with a single trusted data source. You will design pipelines from Salesforce, SQL Server and Gong into analytics-ready datasets and collaborate with AI tools built on top of them.

You will champion medallion architecture, build robust ELT pipelines, refactor legacy pipelines, and improve reliability with automation and data quality checks.