Senior Data Engineer - Lakehouse Pipelines & Data Quality

Careerwebsite; Houston (TX); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Octave seeks a Principal Data Engineer to lead the data flow from source products into the Octave Fabric lakehouse. You will build and operate connectors, pipelines, and staging infra to enable ontological transformation and knowledge-graph construction.

The role requires 7+ years in data engineering, strong Fabric/Azure Synapse experience, and a focus on data quality, governance, and scalable pipelines. Remote work options are available in the US.

Qualifications

• 7+ years in data engineering with hands-on production ETL/ELT pipelines at scale.
• Proficiency with Microsoft Fabric or Azure Synapse Analytics and Delta Lake lakehouse patterns.
• Experience with CDC or database mirroring for SQL Server and Oracle.
• REST API integration and OData/OpenAPI data extraction expertise.
• Strong understanding of Bronze/Silver/Gold lakehouse patterns and data quality.

Responsibilities

• Own data flow from Hexagon source products to the Fabric lakehouse.
• Design, build, and operate ingestion pipelines and staging infrastructure.
• Maintain CDC infrastructure for temporal queries and lineage.
• Ensure data quality, governance, and audit-ready lineage at ingestion time.
• Collaborate on schema understanding for ontological transformation and knowledge graphs.
• Support no-code pipeline capabilities within Platform Studio.

Skills

Python

PySpark

ETL/ELT pipelines

SQL Server

Oracle

REST API integration

Data quality

Spark

Azure Synapse

Microsoft Fabric

OData/OpenAPI

Tools

Databridge Pro

SQL Server

Oracle

Azure Data Factory

Fabric Data Workflows

Airflow

Power BI

Job description

Octave seeks a Principal Data Engineer to lead the data flow from source products into the Octave Fabric lakehouse. You will build and operate connectors, pipelines, and staging infra to enable ontological transformation and knowledge-graph construction.

The role requires 7+ years in data engineering, strong Fabric/Azure Synapse experience, and a focus on data quality, governance, and scalable pipelines. Remote work options are available in the US.