Principal Data Engineer

Geomatik; New York (NY); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Octave is seeking a Data Engineer to own the reliable flow of data from Hexagon sources into the Octave platform's Fabric lakehouse. You will build connectors, pipelines, and staging infra to ensure high-quality data for ontological transformation and knowledge graph construction.

You will implement CDC, near-real-time mirroring, and middleware layers (Databridge Pro), while ensuring strong data quality, lineage, and observability across ingestion and staging.

Qualifications

• 7+ years in data engineering, with hands-on production experience building and operating ETL/ELT pipelines at scale.
• Strong proficiency with Microsoft Fabric or Azure Synapse Analytics — Delta Lake, lakehouse architecture, and Spark-based transformation.
• Experience with database mirroring or CDC for SQL Server (e.g. Fabric Database Mirroring, Debezium, SQL Server replication) and Oracle.
• Hands-on experience with REST API integration and OData/OpenAPI-based data extraction.
• Solid understanding of medallion/lakehouse architecture patterns (Bronze/Silver/Gold or equivalent staging discipline).
• Experience with pipeline orchestration tools (Azure Data Factory, Fabric Data Workflows, Airflow, or comparable).
• Proficiency in Python and/or PySpark for transformation logic and notebook-based ETL.
• Strong data quality mindset — schema validation, null handling, deduplication, and monitoring at ingestion.
• Familiarity with enterprise authentication patterns (OAuth2 client credentials, service principals, managed identities).

Responsibilities

• Design, build, and operate data integration pipelines connecting Hexagon source products to the Fabric lakehouse
• Implement and maintain database mirroring configurations for SQL Server and Oracle source systems with near-real-time replication
• Configure and operate Databridge Pro as a middleware integration layer with API adapters, event streams, and scheduled extracts
• Enforce the staging discipline: land data in its original form in the lakehouse Bronze layer before any transformation
• Build and maintain the change-data-capture (CDC) infrastructure for temporal queries and Delivery Genome
• Own pipeline observability: monitoring, alerting, lineage tracking, and data quality checks at ingestion
• Collaborate with the Graph Engineer on schema mapping to ontological transformation requirements
• Work with Governance to implement data classification, access controls, and audit-ready lineage
• Contribute to no-code pipeline capability within Platform Studio's data engineering tool

Skills

ETL/ELT pipelines

Microsoft Fabric

Azure Synapse

Python / PySpark

SQL Server / Oracle

REST API integration

CDC / change data capture

Data governance

Tools

Databridge Pro

Airflow

Fabric Data Workflows

Job description

Job Location (Short): Houston, Texas-USA | Madison, Alabama-USA | New York - Home Office, New York-USA

Workplace Type: Remote

Responsibilities

The Data Engineer owns the reliable flow of data from Hexagon's source products into the Octave platform's Microsoft Fabric lakehouse. This role is responsible for building and operating the connectors, pipelines, and staging infrastructure that ensure every downstream capability — from ontological transformation to knowledge graph construction — has high-quality, timely, and trustworthy data to work with. The Data Engineer is the first and most critical link in the platform's data supply chain.

• Design, build, and operate data integration pipelines connecting Hexagon source products (Sequence/EcoSys, Loop/Smart Materials, Forte 3D, Attune/EAM) to the Fabric lakehouse
• Implement and maintain database mirroring configurations for SQL Server and Oracle source systems, ensuring near-real-time replication with schema change detection
• Configure and operate Databridge Pro (DBPro) as a middleware integration layer where direct mirroring is not viable — API adapters, event streams, and scheduled extracts
• Enforce the staging discipline: land data in its original form in the lakehouse Bronze layer before any transformation, minimizing logic in extractors and enabling replay
• Build and maintain the change-data-capture (CDC) infrastructure to track record-level changes over time — a prerequisite for temporal queries and the Delivery Genome
• Own pipeline observability: monitoring, alerting, lineage tracking, and data quality checks at ingestion time
• Collaborate with the Graph Engineer on schema understanding to ensure ingested data maps cleanly to ontological transformation requirements
• Work with the Governance function to implement data classification, access controls, and audit-ready lineage at the pipeline level
• Contribute to the no-code pipeline capability within Platform Studio's data engineering tool, informing what connectors and patterns should be productized

Education / Qualifications

• 7+ years in data engineering, with hands-on production experience building and operating ETL/ELT pipelines at scale
• Strong proficiency with Microsoft Fabric or Azure Synapse Analytics — Delta Lake, lakehouse architecture, and Spark-based transformation
• Experience with database mirroring or CDC for SQL Server (e.g. Fabric Database Mirroring, Debezium, SQL Server replication) and Oracle
• Hands-on experience with REST API integration and OData/OpenAPI-based data extraction
• Solid understanding of medallion/lakehouse architecture patterns (Bronze/Silver/Gold or equivalent staging discipline)
• Experience with pipeline orchestration tools (Azure Data Factory, Fabric Data Workflows, Airflow, or comparable)
• Proficiency in Python and/or PySpark for transformation logic and notebook-based ETL
• Strong data quality mindset — schema validation, null handling, deduplication, and monitoring at ingestion
• Familiarity with enterprise authentication patterns (OAuth2 client credentials, service principals, managed identities)

Preferred:

• Experience with Databridge Pro or comparable industrial middleware integration products
• Background in capital projects, EPC, or industrial enterprise software data models
• Exposure to knowledge graph construction pipelines downstream of lakehouse staging

About Octave

Octave provides mission-critical software that empowers organizations to make informed decisions across every stage of the asset lifecycle - Design, Build, Operate and Protect - where performance, safety, and reliability are non-negotiable and failure is not an option.

Turning complex operational data into actionable intelligence, Octave connects expertise, real-world conditions and enterprise-scale insight to improve performance, resilience and incident response where it matters most.

Octave has more than 7,000 employees in 45 countries. Learn more at octave.com and follow us on LinkedIn .

Why work for Octave?

All in. Always forward. That's the way we do things around here. We put trust in our people because we believe it's the best way to unleash potential, bring ideas to life, and keep moving ahead. And it's why we're committed to creating an environment that's truly supportive, providing you with the resources you need to support your ambitions, no matter who you are or where you are in the world.

Everyone is welcome

At Octave, we believe that diverse and inclusive teams are critical to the success of our people and our business. Here, everyone is welcome. As an inclusive workplace, we don't discriminate. In fact, we embrace differences and are fully committed to creating equal opportunities, an inclusive environment, and fairness for all.

Respect is the cornerstone of how we operate, so speak up and be yourself. You're valued here.

Recruitment Fraud Alert

Octave posts all official job opportunities on either https://careers.octave.com/ or https://www.octave.com/about/careers and communicates only from email addresses ending [e-mail]. We never request payment or personal banking information during recruitment. No offers will ever be extended without a proper interview via Teams or in person, never done over email alone. If you suspect fraud, it probably is, and contact us at [e-mail]