Senior Data Engineer – Lakehouse, AI & Pipelines

Home Organizers; Glendale (CA); On-site; USD 200,000 - 250,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Life Insurance

401K Retirement Plan

Paid Vacation Time

Paid Holidays

Job summary

Home Organizers, Inc. in Glendale, CA, seeks a hands-on data engineer who will own the platform end-to-end—from ingestion to BI reporting and AI integration.

You will design, build, and operate batch and streaming pipelines, lakehouse governance, and a governed semantic layer, with strong emphasis on data quality and security. This role requires 8+ years in data engineering, deep Databricks experience, dbt, and the ability to partner with senior leaders to define metrics and trade-offs.

Qualifications

• 8+ years in data engineering, including ownership of a production cloud data platform end-to-end.
• Hands-on production experience with Databricks: Unity Catalog, Delta, Workflows/Lakeflow Jobs, and SQL warehouses.
• Expert dbt and dimensional modeling with a governed metrics layer.
• Strong SQL and Python. Comfortable with Git, CI/CD, and infrastructure as code.
• Built governed BI on a semantic model with row-level security and alerting.
• Delivered both managed-connector ingestion and custom pipelines with CDC and API sources.
• Shipped pipelines turning unstructured data into structured data using transcription, OCR, or vision models.
• Operated models in production with MLflow, including versioning and monitoring.
• Implemented data access controls and identity-provider based permissions.
• Experience with entity resolution across source systems.
• Written clear API requirements for data/AI integrations.
• Able to define metrics with senior business leaders and explain trade-offs.

Responsibilities

• Ingestion: design, build, and operate batch and streaming pipelines from SaaS apps, databases, APIs, and in-house systems.
• Lakehouse and governance: build and administer a Databricks lakehouse with Unity Catalog, row filters, and lineage.
• Modeling and semantic layer: develop dimensional models and a governed metrics layer; own testing and data quality.
• Unstructured data and ML: build pipelines for audio, video, documents, images; deploy and monitor models with MLflow.
• AI integration: build LLM integrations with read/write capabilities and audit logging.
• APIs: define integration requirements and build against them.
• Reporting: create governed dashboards and alerting on a semantic-model BI platform.
• Observability: monitor pipeline freshness and data quality with proactive alerts.

Skills

Data engineering

SQL

Python

Stakeholder communication

Cloud platforms

Tools

Databricks Unity Catalog

Delta Lake

dbt

MLflow

Looker/Sigma/Omni

Git

CI/CD

Airbyte/Fivetran

Job description

Home Organizers, Inc. in Glendale, CA, seeks a hands-on data engineer who will own the platform end-to-end—from ingestion to BI reporting and AI integration.

You will design, build, and operate batch and streaming pipelines, lakehouse governance, and a governed semantic layer, with strong emphasis on data quality and security. This role requires 8+ years in data engineering, deep Databricks experience, dbt, and the ability to partner with senior leaders to define metrics and trade-offs.