Remote Senior Data Engineer — Lakehouse & Pipelines

Careerwebsite; Houston (TX); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Octave seeks a Senior Data Engineer to own data flow from source products into the Fabric lakehouse. You will build connectors, pipelines, and staging infra ensuring high-quality, timely data for downstream ontological transformations and knowledge graphs.

You will implement CDC, maintain data quality checks, and collaborate with governance on classifications and access controls. Remote work is supported, with strong emphasis on scalable ETL/ELT pipelines and orchestration.

Qualifications

• 3+ years in data engineering with production ETL/ELT pipelines at scale.
• Strong proficiency with Microsoft Fabric or Azure Synapse Analytics.
• Experience with database mirroring or CDC for SQL Server and Oracle.
• REST API integration and OpenAPI-based data extraction.
• Medallion/lakehouse architecture patterns (Bronze/Silver/Gold).
• Experience with pipeline orchestration tools (Azure Data Factory, Fabric Data Workflows, Airflow).
• Proficiency in Python and/or PySpark for transformation logic.
• Strong data quality mindset: schema validation, deduplication and ingestion lineage.
• Familiarity with enterprise authentication patterns (OAuth2, service principals).

Responsibilities

• Design, build, and operate data integration pipelines connecting Hexagon source products to the Fabric lakehouse.
• Implement and maintain near-real-time CDC for key source systems and Oracle integration.
• Configure Databridge Pro as a middleware layer where direct mirroring is not viable.
• Enforce the staging discipline: land data in its original form in Bronze layer.
• Build and maintain CDC infrastructure for temporal queries and lineage.
• Own pipeline observability: monitoring, alerts, lineage, and data quality at ingestion.
• Collaborate with Graph Engineer on ontology mapping for ingestion to transformations.
• Support governance to implement data classification and access controls at the pipeline level.
• Contribute to no-code pipeline capabilities informing connectors and patterns.

Skills

Data pipeline design

SQL Server / Oracle

Python / PySpark

Microsoft Fabric / Azure Synapse

CDC / data replication

REST API integration

Data quality & governance

Tools

Databridge Pro

Azure Data Factory

Fabric Data Workflows

Airflow

Debezium

Job description

Octave seeks a Senior Data Engineer to own data flow from source products into the Fabric lakehouse. You will build connectors, pipelines, and staging infra ensuring high-quality, timely data for downstream ontological transformations and knowledge graphs.

You will implement CDC, maintain data quality checks, and collaborate with governance on classifications and access controls. Remote work is supported, with strong emphasis on scalable ETL/ELT pipelines and orchestration.