Remote Senior Databricks Data Engineer — ERP & Logistics Data

Lumenalta

United States

Remote

USD 120,000 - 180,000

Full time

2 days ago

Be an early applicant

Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Lumenalta is seeking a Senior Data Engineer to build and optimize data ingestion pipelines in Databricks, connecting cost, supplier, and logistics data from Oracle E-Business Suite and SLICwave to engineering data. You will implement incremental and batch refresh, manage schema evolution, and ensure data quality across parts, revisions, and BOMs.

You will collaborate with security reviewers, data stewards, and ERP SMEs, and will work in a fully remote role within the United States, with

Qualifications

6+ years in data engineering with ingestion pipelines on Databricks.
Knowledge of Oracle E-Business Suite data structures (cost, supplier, BOM).
Experience with relational ingestion into Databricks from Oracle/SQL Server.
Understanding of Oracle E-Business Suite's multi-org security model.
Proficiency in PySpark and SQL; Delta Lake internals knowledge.
Experience with Databricks Workflows for orchestration.

Responsibilities

Ingest cost and supplier data from Oracle E-Business Suite into Databricks via S3 or direct reads.
Ingest SLICwave logistics data into Databricks and work with its relational backend.
Implement incremental and batch refresh patterns for both sources.
Configure schema evolution and baseline data quality checks in pipelines.
Model data linking to parts, revisions, and BOM structures from Teamcenter.
Document integration designs for security review and assist with security reviewers.
Orchestrate pipelines with Databricks Workflows and capture lineage.
Collaborate with logistics and ERP SMEs to understand data structures.