Senior Databricks Data Engineer, Digital Thread Modeling

Lumenalta; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote work

Job summary

Lumenalta is seeking a senior data engineer to build the digital thread and gold data products using Databricks, Unity Catalog, and Delta Lake. You will map traceability across requirements, models, parts, and revisions to deliver robust data pipelines.

Collaborate with SMEs from Cameo, Teamcenter, and Capital to design the gold layer for digital thread and twin use cases, and document data models and lineage. This is a fully remote US position on a government contract.

Qualifications

• 6+ years in data engineering with production data modeling on Databricks or a comparable lakehouse.
• Strong data modeling skills, including relationship-heavy or graph-like models and entity resolution across systems.
• Experience keying the same entity across multiple source systems, such as part number plus revision.
• Working fluency in PLM and MBSE concepts and vocabulary, such as parts, BOMs, revisions, change objects, SysML model elements, and requirements traceability.
• Hands-on experience with data from at least one of Teamcenter, Cameo, or Siemens Capital.
• Experience with Databricks declarative pipelines or Delta Live Tables, including data quality expectations.
• Experience publishing governed tables in Unity Catalog with documentation and tags.

Responsibilities

• Implement the v1 program-agnostic digital thread schema in Databricks, including artifact attributes and the relationships between them.
• Map existing traceability relationships across requirements, system models, parts, and revisions into the new schema for each MVP capability.
• Implement part and revision keying across multiple source systems to support a program-specialized bill of materials.
• Build Silver-to-Gold transformations in Databricks declarative pipelines, with data quality expectations on keys, relationships, and completeness.
• Publish Gold tables as governed data products in Unity Catalog, with documentation, tags, and ownership.
• Work with source system SMEs to resolve how Cameo, Teamcenter, and Capital represent the same engineering concepts differently.
• Design the Gold layer so it can serve the digital thread and digital twin use cases.
• Document data models, business rules, and lineage for handoff.

Skills

PySpark

SQL

Data modeling

Entity resolution

Stakeholder collaboration

Tools

Databricks

Delta Live Tables

Unity Catalog

Delta Lake

Job description

About the Role

We partner with global enterprises to design and build large-scale data platforms that power the products and operations at the center of their business.

The core of the platform is a digital thread: a connected view of requirements, system models, parts, revisions, and electrical designs that today live in separate tools such as Cameo, Teamcenter, and Siemens Capital. Ingesting that data is only half the job. It becomes valuable when the relationships between artifacts are modeled correctly and a part in one system can be traced to its requirement, model element, and harness design in another.

You will build that curated layer. You will take the Silver tables the ingestion engineers produce from Cameo, Teamcenter, and Capital, key and relate them, and publish them as governed Gold data products that the digital thread and its downstream users can trust.

What You'll Do

• Implement the v1 program-agnostic digital thread schema in Databricks, including artifact attributes and the relationships between them.
• Map existing traceability relationships across requirements, system models, parts, and revisions into the new schema for each MVP capability.
• Implement part and revision keying across multiple source systems to support a program-specialized bill of materials.
• Build Silver-to-Gold transformations in Databricks declarative pipelines, with data quality expectations on keys, relationships, and completeness.
• Publish Gold tables as governed data products in Unity Catalog, with documentation, tags, and ownership.
• Work with source system SMEs to resolve how Cameo, Teamcenter, and Capital represent the same engineering concepts differently.
• Design the Gold layer so it can serve the digital thread and digital twin use cases.
• Document data models, business rules, and lineage for handoff.

What We're Looking For

• 6+ years in data engineering, including production data modeling on Databricks or a comparable lakehouse.
• Strong data modeling skills, including relationship-heavy or graph-like models and entity resolution across systems.
• Experience keying the same entity across multiple source systems, such as part number plus revision.
• Working fluency in PLM and MBSE concepts and vocabulary, such as parts, BOMs, revisions, change objects, SysML model elements, and requirements traceability.
• Hands-on experience with data from at least one of Teamcenter, Cameo, or Siemens Capital.
• Experience with Databricks declarative pipelines or Delta Live Tables, including data quality expectations.
• Experience publishing governed tables in Unity Catalog with documentation and tags.
• Strong PySpark and SQL, and experience with Delta Lake and medallion architecture.
• Experience working directly with engineering stakeholders to define data definitions and business rules.
• Ability to complete the client's background check and onboarding and to work on client-furnished equipment.

Nice to Have

• Familiarity with digital thread or digital twin reference architectures.
• Experience with SLICwave or logistics support analysis data.
• Prior work in a defense, aerospace, or FedRAMP environment, or with CUI or ITAR-controlled data.
• Databricks Data Engineer Professional certification.

Why Lumenalta is an amazing place to work at

At Lumenalta, you can expect that you will:

• Be 100% dedicated to one project at a time so that you can innovate and grow.
• Be a part of a team of talented and friendly senior-level developers.
• Work on projects that allow you to use leading tech.

For Databricks practitioners specifically, we are a Databricks partner with Champions and MVPs on our team, and that carries three concrete things:

• Delivery Partner Program qualification. Databricks co-delivers its Professional Services engagements through a short list of approved partner organizations, and practitioners have to be individually qualified before they can work on them. The qualification is granted once at the individual level and does not expire, so it stays with you. Partner organizations are the route in, so the qualified pool stays small. That scarcity is most of the value, and we sponsor it.
• Champion path. Databricks Champion is an individual recognition with its own badge, a dedicated Databricks solutions architect as your mentor, access to product teams, confidential roadmap briefings, and an invitation to the internal Tech Summit. Nomination has to come from a partner organization, which puts it out of reach for independents and most contractors. We nominate actively and regularly, and the Champions already on our team mentor candidates through it.
• Certifications covered. We pay the exam fee for any Databricks certification you want to take.

Our Process

A screening call, a technical interview, and a HackerRank assessment.

The technical interview is a conversation rather than a whiteboard exam. We will ask you to walk through a data model you designed across multiple engineering systems, how you keyed parts and revisions, how you validated traceability, and what you would change. Relevant project experience matters more to us than certifications.

Location

This is a fully remote position.

This position supports a U.S. Government contract that requires all personnel to possess U.S. Citizenship.

This role is remote within the United States only. Candidates must reside in the United States while assigned to our client and be physically located within the United States when performing project work or accessing project systems or data. Availability to work overlapping Pacific, Central, or Eastern U.S. time zones.

Application Deadline

Applications will be accepted until October 4th, 2026. Candidates can expect feedback by October 12th, 2026.