Principal Data Engineer

Hexagon AB

United States

Remote

USD 150,000 - 210,000

Full time

6 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Octave seeks a Principal Data Engineer to own the reliable flow of data from Hexagon source products into the Octave platform's Fabric lakehouse. You will design, build, and operate connectors, pipelines, and staging infra to ensure high-quality, timely data for downstream capabilities.

Responsibilities include implementing CDC, staging discipline, pipeline observability, and collaboration with Graph and Governance teams.

Qualifications

  • 7+ years in data engineering with production ETL/ELT experience.
  • Strong proficiency with Microsoft Fabric or Azure Synapse.
  • Experience with SQL Server mirroring or CDC and Oracle.
  • REST API integration and OpenAPI-based data extraction.
  • Knowledge of medallion/lakehouse patterns and data governance basics.
  • Experience with orchestration tools (ADF, Fabric Data Workflows, Airflow).

Responsibilities

  • Design, build, and operate data integration pipelines to Fabric lakehouse.
  • Implement and maintain database mirroring for SQL Server and Oracle.
  • Configure and operate Databridge Pro as middleware integration layer.
  • Enforce staging discipline: land data Bronze layer before transformation.
  • Build and maintain the CDC infrastructure for temporal queries.
  • Own pipeline observability: monitoring, lineage, and data quality checks.
  • Collaborate with Graph Engineer on schema understanding for ontologies.
  • Work with Governance to implement classification and lineage.
  • Contribute to no-code pipeline capabilities in Platform Studio.

Skills

ETL/ELT pipelines
Microsoft Fabric
Azure Synapse
Delta Lake
Spark-based transformation
Python
PySpark
REST API integration
OData/OpenAPI data extraction
Data quality mindset
CDC implementation
Data governance collaboration

Tools

SQL Server
Oracle
Databridge Pro
Azure Data Factory
Fabric Data Workflows
Airflow

Job description

Principal Data Engineer

Job Location (Short): Houston, Texas-USA | Madison, Alabama-USA | New York - Home Office, New York-USA

Workplace Type: Remote

Responsibilities

The Data Engineer owns the reliable flow of data from Hexagon's source products into the Octave platform's Microsoft Fabric lakehouse. This role is responsible for building and operating the connectors, pipelines, and staging infrastructure that ensure every downstream capability - from ontological transformation to knowledge graph construction - has high-quality, timely, and trustworthy data to work with. The Data Engineer is the first and most critical link in the platform's data supply chain.

  • Design, build, and operate data integration pipelines connecting Hexagon source products (Sequence/EcoSys, Loop/Smart Materials, Forte 3D, Attune/EAM) to the Fabric lakehouse
  • Implement and maintain database mirroring configurations for SQL Server and Oracle source systems, ensuring near-real-time replication with schema change detection
  • Configure and operate Databridge Pro (DBPro) as a middleware integration layer where direct mirroring is not viable - API adapters, event streams, and scheduled extracts
  • Enforce the staging discipline: land data in its original form in the lakehouse Bronze layer before any transformation, minimizing logic in extractors and enabling replay
  • Build and maintain the change-data-capture (CDC) infrastructure to track record-level changes over time - a prerequisite for temporal queries and the Delivery Genome
  • Own pipeline observability: monitoring, alerting, lineage tracking, and data quality checks at ingestion time
  • Collaborate with the Graph Engineer on schema understanding to ensure ingested data maps cleanly to ontological transformation requirements
  • Work with the Governance function to implement data classification, access controls, and audit-ready lineage at the pipeline level
  • Contribute to the no-code pipeline capability within Platform Studio's data engineering tool, informing what connectors and patterns should be productized
Education / Qualifications
  • 7+ years in data engineering, with hands-on production experience building and operating ETL/ELT pipelines at scale
  • Strong proficiency with Microsoft Fabric or Azure Synapse Analytics - Delta Lake, lakehouse architecture, and Spark-based transformation
  • Experience with database mirroring or CDC for SQL Server (e.g. Fabric Database Mirroring, Debezium, SQL Server replication) and Oracle
  • Hands-on experience with REST API integration and OData/OpenAPI-based data extraction
  • Solid understanding of medallion/lakehouse architecture patterns (Bronze/Silver/Gold or equivalent staging discipline)
  • Experience with pipeline orchestration tools (Azure Data Factory, Fabric Data Workflows, Airflow, or comparable)
  • Proficiency in Python and/or PySpark for transformation logic and notebook-based ETL
  • Strong data quality mindset - schema validation, null handling, deduplication, and monitoring at ingestion
  • Familiarity with enterprise authentication patterns (OAuth2 client credentials, service principals, managed identities)
Preferred
  • Experience with Databridge Pro or comparable industrial middleware integration products
  • Background in capital projects, EPC, or industrial enterprise software data models
  • Exposure to knowledge graph construction pipelines downstream of lakehouse staging
About Octave

Octave provides mission-critical software that empowers organizations to make informed decisions across every stage of the asset lifecycle - Design, Build, Operate and Protect - where performance, safety, and reliability are non-negotiable and failure is not an option.

Turning complex operational data into actionable intelligence, Octave connects expertise, real-world conditions and enterprise-scale insight to improve performance, resilience and incident response where it matters most.

Octave has more than 7,000 employees in 45 countries. Learn more at octave.com and follow us on LinkedIn.

Why work for Octave?

All in. Always forward. That's the way we do things around here. We put trust in our people because we believe it's the best way to unleash potential, bring ideas to life, and keep moving ahead. And it's why we're committed to creating an environment that's truly supportive, providing you with the resources you need to support your ambitions, no matter who you are or where you are in the world.

Everyone is welcome

At Octave, we believe that diverse and inclusive teams are critical to the success of our people and our business. Here, everyone is welcome. As an inclusive workplace, we don't discriminate. In fact, we embrace differences and are fully committed to creating equal opportunities, an inclusive environment, and fairness for all.

Respect is the cornerstone of how we operate, so speak up and be yourself. You're valued here.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Engineer
Principal Data Engineer

Careerwebsite • Houston (TX)

Hybrid
USD 150,000 - 190,000
Senior Data Engineer
Senior Data Engineer

Careerwebsite • Houston (TX)

Hybrid
USD 120,000 - 180,000
Principal Software Developer
Principal Software Developer

Hexagon AB • United States

Remote
USD 140,000 - 190,000
Principal Data Engineer
Principal Data Engineer

Octus • New York (NY)

On-site
USD 180,000 - 230,000
Competitive health benefits
Matched 401k and pension
PTO
+4
Principal DevOps Engineer
Principal DevOps Engineer

Octave • United States

Remote
USD 140,000 - 190,000
Senior Quality Assurance Engineer - Data & Analytics
Senior Quality Assurance Engineer - Data & Analytics

Octave • Town of Texas (WI)

On-site
USD 110,000 - 160,000
Principal Data Engineer
Principal Data Engineer

Watershed Ventures • United States

On-site
USD 160,000 - 230,000
Competitive health benefits
Matched 401k and pension plans
PTO
+3
Lead Data Scientist
Lead Data Scientist

Geomatik • Northern (KY)

On-site
USD 120,000 - 190,000
Sr. Data Engineer
Sr. Data Engineer

Octave • San Francisco (CA)

On-site
USD 142,600 - 176,000
Equity in the form of stock options
Medical, dental, vision benefits
Generous paid time off
+1
Manager, Software Development
Manager, Software Development

Octave • Houston (TX)

On-site
USD 120,000 - 180,000
Remote work-friendly