Principal Data Engineer: Enterprise Data Platform Lead

Energy Jobline ZR; Seattle (WA); On-site; USD 170,000 - 210,000; Full time

Job summary

BrickRed Systems is seeking an experienced Principal Data Engineer to lead the design, development, and optimization of enterprise-scale data platforms for finance and revenue data supporting Finance/RDMP initiatives.

You will architect and implement scalable ETL/ELT pipelines using Snowflake, Databricks, Delta Lake, dbt, PySpark, and real-time processing with Kafka and Airflow. Strong leadership and collaboration across stakeholders are essential.

Qualifications

• 7+ years of experience with Snowflake and Delta Lake.
• 7+ years of experience with Databricks, Delta Live Tables (DLT), and Unity Catalog.
• 5+ years of experience with dbt and PySpark.
• Strong expertise in data engineering, ETL/ELT pipelines, and enterprise-scale data architecture.
• Advanced SQL skills, including query optimization and complex transformations.
• Experience with data modeling, data integration, and distributed data processing.
• Strong understanding of data quality, automated testing, monitoring, and observability.
• Experience with CI/CD, version control, deployment practices, and production support.
• Knowledge of data security, governance, access controls, and compliance requirements.
• Strong technical leadership, problem-solving, communication, and stakeholder management skills.

Responsibilities

• Architect and develop scalable ETL/ELT data pipelines for enterprise finance and revenue data.
• Establish data ingestion, transformation, orchestration, and real-time processing solutions using DLT, dbt, Kafka, Airflow, and Azure Data Factory.
• Optimize data platforms, SQL queries, pipeline performance, cloud infrastructure, and operational costs.
• Implement data quality, automated testing, monitoring, security, governance, and compliance standards.
• Design and optimize enterprise data models while ensuring data accuracy, reliability, and consistency.
• Establish CI/CD pipelines, reusable frameworks, coding standards, and deployment best practices.
• Perform production troubleshooting, root cause analysis, defect resolution, and continuous improvement.
• Lead technical architecture and design decisions, mentor senior engineers, and collaborate with cross-functional teams and business stakeholders.

Skills

Data engineering leadership

SQL optimization

Problem solving

Stakeholder management

Tools

Snowflake

Delta Lake

Databricks

Delta Live Tables (DLT)

Unity Catalog

dbt

PySpark

Kafka

Airflow

Azure Data Factory

Great Expectations

GitHub Actions

Azure DevOps

Job description

BrickRed Systems is seeking an experienced Principal Data Engineer to lead the design, development, and optimization of enterprise-scale data platforms for finance and revenue data supporting Finance/RDMP initiatives.

You will architect and implement scalable ETL/ELT pipelines using Snowflake, Databricks, Delta Lake, dbt, PySpark, and real-time processing with Kafka and Airflow. Strong leadership and collaboration across stakeholders are essential.