Senior Data Platform Engineer – Lakehouse & AI Pipelines

Brio Water; Glendale, Northern (CA, KY); Hybrid; USD 200,000 - 250,000; Full time

Benefits offered by this job

401K Retirement Plan

Paid Vacation Time

Paid Holidays

and More!

Job summary

Brio Water Technology, a Home Organizers, Inc. company, seeks a strong data engineer to own the full data platform from ingestion to reporting. You will design, build, and operate pipelines, governance, ML integration, and BI reporting in a hands-on role.

Expect collaboration with business partners, rigorous testing, and on-site work in Glendale, CA. Expertise in Databricks, dbt, SQL, Python, and data governance is essential.

Qualifications

• 8+ years in data engineering, including at least 3 owning a production cloud data platform end to end, from ingestion through the reporting layer.
• Hands-on production experience with Databricks: Unity Catalog, Delta, Workflows/Lakeflow Jobs, and SQL warehouses.
• Expert dbt and dimensional modeling: layered projects, tests, documentation, and a semantic or metrics layer (MetricFlow, Metric Views, or LookML).
• Strong SQL and Python. Comfortable with Git, CI/CD, and infrastructure as code.
• Built governed BI on a semantic model (Omni, Sigma, Looker, or similar) with row-level security, scheduled delivery, and alerting.
• Delivered both managed-connector ingestion (Lakeflow Connect, Fivetran, Airbyte) and custom pipelines, including CDC and API sources.
• Shipped at least one pipeline that turns unstructured data (audio, documents, or images) into structured data using transcription, OCR, LLM classification, or vision models.
• Operated models in production with MLflow or an equivalent registry, including versioning, scoring jobs, and monitoring.
• Implemented data access controls: row filters, column masks, PII handling, and group-based permissions synced from an identity provider.
• Solved entity resolution across multiple source systems (customers, locations, or employees).
• Built integrations that write back to production systems with authorization checks, idempotency, rollback, and audit logging.

Responsibilities

• Ingestion: Design, build, and operate batch and streaming pipelines from SaaS applications, databases, APIs, and custom in-house systems.
• Lakehouse and governance: Build and administer a Databricks lakehouse with Unity Catalog, including lineage and identity-provider group sync.
• Modeling and semantic layer: Develop dimensional models and a governed metrics layer in dbt; own testing and data quality.
• Unstructured data and ML: Turn audio, video, documents, images, and telemetry into structured data using transcription, OCR, and ML models.
• AI integration: Build and maintain LLM integrations with read/write capabilities, enforcing permissions and audit logging.
• APIs: Define integration requirements and build against them.
• Reporting: Build governed dashboards and scheduled delivery on a semantic-model BI platform.
• Observability: Monitor pipeline freshness, data quality, model performance, and index health.

Skills

Databricks

SQL

Python

CI/CD

Infrastructure as code

Data governance

NumPy/pandas

MLflow

Entity resolution

Vector/LLM data

Tools

Unity Catalog

Delta

Lakehouse workflows

SQL warehouses

Job description

Brio Water Technology, a Home Organizers, Inc. company, seeks a strong data engineer to own the full data platform from ingestion to reporting. You will design, build, and operate pipelines, governance, ML integration, and BI reporting in a hands-on role.

Expect collaboration with business partners, rigorous testing, and on-site work in Glendale, CA. Expertise in Databricks, dbt, SQL, Python, and data governance is essential.