Senior Databricks Data Engineer - Remote Gold Data Products

Lumenalta; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote work

Job summary

Lumenalta is seeking a senior data engineer to build the digital thread and gold data products using Databricks, Unity Catalog, and Delta Lake. You will map traceability across requirements, models, parts, and revisions to deliver robust data pipelines.

Collaborate with SMEs from Cameo, Teamcenter, and Capital to design the gold layer for digital thread and twin use cases, and document data models and lineage. This is a fully remote US position on a government contract.

Qualifications

• 6+ years in data engineering with production data modeling on Databricks or a comparable lakehouse.
• Strong data modeling skills, including relationship-heavy or graph-like models and entity resolution across systems.
• Experience keying the same entity across multiple source systems, such as part number plus revision.
• Working fluency in PLM and MBSE concepts and vocabulary, such as parts, BOMs, revisions, change objects, SysML model elements, and requirements traceability.
• Hands-on experience with data from at least one of Teamcenter, Cameo, or Siemens Capital.
• Experience with Databricks declarative pipelines or Delta Live Tables, including data quality expectations.
• Experience publishing governed tables in Unity Catalog with documentation and tags.

Responsibilities

• Implement the v1 program-agnostic digital thread schema in Databricks, including artifact attributes and the relationships between them.
• Map existing traceability relationships across requirements, system models, parts, and revisions into the new schema for each MVP capability.
• Implement part and revision keying across multiple source systems to support a program-specialized bill of materials.
• Build Silver-to-Gold transformations in Databricks declarative pipelines, with data quality expectations on keys, relationships, and completeness.
• Publish Gold tables as governed data products in Unity Catalog, with documentation, tags, and ownership.
• Work with source system SMEs to resolve how Cameo, Teamcenter, and Capital represent the same engineering concepts differently.
• Design the Gold layer so it can serve the digital thread and digital twin use cases.
• Document data models, business rules, and lineage for handoff.

Skills

PySpark

SQL

Data modeling

Entity resolution

Stakeholder collaboration

Tools

Databricks

Delta Live Tables

Unity Catalog

Delta Lake

Job description

Lumenalta is seeking a senior data engineer to build the digital thread and gold data products using Databricks, Unity Catalog, and Delta Lake. You will map traceability across requirements, models, parts, and revisions to deliver robust data pipelines.

Collaborate with SMEs from Cameo, Teamcenter, and Capital to design the gold layer for digital thread and twin use cases, and document data models and lineage. This is a fully remote US position on a government contract.