Senior Databricks Data Engineer, ERP & Logistics Data

Lumenalta; United States; Remote; USD 90,000 - 132,000; Full time

Benefits offered by this job

Health insurance

401K Contribution

Professional development fund

15 days of paid time off annually

Soft-skill development courses

Job summary

Lumenalta seeks a Senior Databricks Data Engineer to architect and implement large-scale ingestion of ERP and logistics data into a unified Databricks platform. You will connect Oracle E-Business Suite, SLICwave, and other sources to part/revision data from engineering systems, enabling secure, scalable analytics.

You will collaborate with security reviewers, data stewards, and SMEs, and you will orchestrate end-to-end pipelines with Databricks Workflows while ensuring proper lineage and

Qualifications

• 6+ years in data engineering, including production experience building ingestion pipelines on Databricks.
• Working knowledge of Oracle E-Business Suite data structures, including cost, supplier, item, and BOM tables.
• Experience with relational ingestion into Databricks from Oracle, SQL Server, or comparable databases.
• Understanding of Oracle E-Business Suite's multi-org security model and how it affects returns.
• Experience with Auto Loader and file-based ingestion from S3.
• Experience with Databricks declarative pipelines or Delta Live Tables, including schema evolution configuration.
• Experience modeling ERP or logistics data so it joins to engineering or product data.

Responsibilities

• Ingest cost and supplier data from Oracle E-Business Suite into Databricks, using file-based ingestion from S3 extracts or direct read access.
• Ingest SLICwave logistics support analysis data into Databricks, working with its relational backend and file exports.
• Implement incremental and batch refresh patterns for both sources, starting from representative extracts where direct access is still pending.
• Configure schema evolution and baseline data quality checks in Databricks declarative pipelines.
• Model cost, supplier, and logistics data so it links to parts, revisions, and BOM structures from Teamcenter and other engineering sources.
• Support the architect in presenting the Oracle integration approach to enterprise security reviewers, including documentation of access patterns and controls.
• Orchestrate pipelines with Databricks Workflows and ensure lineage is captured for every pipeline.
• Work with logistics and ERP SMEs to understand data structures, business rules, and extraction constraints.

Skills

PySpark

SQL

Data modeling

Delta Lake

ETL design

Tools

Databricks

Oracle E-Business Suite

Delta Lake internals

S3 ingestion

Job description

# Senior Databricks Data Engineer, ERP & Logistics DataData Engineer#### About the RoleWe partner with global enterprises to design and build large-scale data platforms that power the products and operations at the center of their business.A part is not just a design. It has cost and supplier data in Oracle E-Business Suite, and a logistics record, including maintenance tasks, provisioning, and support requirements, in a logistics support analysis system. The digital thread is only complete when those records connect to the engineering data coming from PLM and system models.You will build that connection. You will bring read-only cost, supplier, and logistics data from Oracle E-Business Suite and SLICwave into Databricks, whether it arrives as database extracts landed in S3 or through direct read access once the client's security approvals are in place, and model it so it links cleanly to parts and revisions across the platform.#### What You'll Do* Ingest cost and supplier data from Oracle E-Business Suite into Databricks, using file-based ingestion from S3 extracts or direct read access, including session-level init parameter handling to work within row-level security.* Ingest SLICwave logistics support analysis data into Databricks, working with its relational backend and file exports.* Implement incremental and batch refresh patterns for both sources, starting from representative extracts where direct access is still pending.* Configure schema evolution and baseline data quality checks in Databricks declarative pipelines.* Model cost, supplier, and logistics data so it links to parts, revisions, and BOM structures from Teamcenter and other engineering sources.* Support the architect in presenting the Oracle integration approach to enterprise security reviewers, including documentation of access patterns and controls.* Orchestrate pipelines with Databricks Workflows and ensure lineage is captured for every pipeline.* Work with logistics and ERP SMEs to understand data structures, business rules, and extraction constraints.#### What We're Looking For* 6+ years in data engineering, including production experience building ingestion pipelines on Databricks.* Working knowledge of Oracle E-Business Suite data structures, including cost, supplier, item, and BOM tables.* Experience with relational ingestion into Databricks from Oracle, SQL Server, or comparable databases.* Understanding of Oracle E-Business Suite's multi-org security model and how it affects returns.* Experience with Auto Loader and file-based ingestion from S3.* Experience with Databricks declarative pipelines or Delta Live Tables, including schema evolution configuration.* Experience modeling ERP or logistics data so it joins to engineering or product data.* Strong PySpark and SQL, and working knowledge of Delta Lake internals such as managed vs. external tables and predictive optimization.* Experience with Databricks Workflows for orchestration.* Clear written communication, including documenting integration designs for security review.* Ability to complete the client's background check and onboarding and to work on client-furnished equipment.* US citizenship.* Fluent English, both written and spoken.#### Nice to Have* Familiarity with PLM data, such as Teamcenter parts, BOMs, and revisions.* Familiarity with logistics support analysis (LSA/LSAR) data, such as GEIA-STD-0007 or MIL-STD-1388-2B structures. SLICwave experience is a plus* Experience migrating Oracle or EDW workloads to Databricks.* Experience with Lakeflow Connect or other CDC-based ingestion tools.* Prior work in a defense, aerospace, or FedRAMP environment, or with CUI or ITAR-controlled data.* Databricks Data Engineer Professional certification.#### Why Lumenalta is an amazing place to work atAt Lumenalta, you can expect that you will:* Be 100% dedicated to one project at a time so that you can innovate and grow.* Be a part of a team of talented and friendly senior-level developers.* Work on projects that allow you to use leading tech.For Databricks practitioners specifically, we are a Databricks partner with Champions and MVPs on our team, and that carries three concrete things:* **Delivery Partner Program qualification**. Databricks co-delivers its Professional Services engagements through a short list of approved partner organizations, and practitioners have to be individually qualified before they can work on them. The qualification is granted once at the individual level and does not expire, so it stays with you. Partner organizations are the route in, so the qualified pool stays small. That scarcity is most of the value, and we sponsor it.* **Champion path**. Databricks Champion is an individual recognition with its own badge, a dedicated Databricks solutions architect as your mentor, access to product teams, confidential roadmap briefings, and an invitation to the internal Tech Summit. Nomination has to come from a partner organization, which puts it out of reach for independents and most contractors. We nominate actively and regularly, and the Champions already on our team mentor candidates through it.* **Certifications covered.** We pay the exam fee for any Databricks certification you want to take.#### Our ProcessA screening call, a technical interview, and a HackerRank assessment.The technical interview is a conversation rather than a whiteboard exam. We will ask you to walk through a governance design you have shipped, a federate-versus-ingest call you made, what you would change, and what you would expect security reviewers to push hardest on. We will also ask for a writing sample. Relevant project references matter more to us than certifications.#### LocationThis is a fully remote position.This position supports a U.S. Government contract that requires all personnel to possess U.S. Citizenship.This role is remote within the United States only. Candidates must reside in the United States while assigned to our client and be physically located within the United States when performing project work or accessing project systems or data. Availability to work overlapping Pacific, Central, or Eastern U.S. time zones.#### Application DeadlineApplications will be accepted until **October 4th, 2026**. Candidates can expect feedback by **October 12th, 2026**.## Salary**Salary range:** $90k - $132k annually, with final compensation determined by your qualifications, expertise, experience, and the role's scope.## BenefitsIn addition to competitive pay, we offer a variety of benefits to support your professional and personal growth, including:* Flexible working hours in a remote environment.* Health insurance (medical and dental) for W2 Employees.* 401K Contribution.* A professional development fund to enhance your skills and knowledge.* 15 days of paid time off annually.* Access to soft-skill development courses to further your career.## Position DetailsThis is a full-time position requiring a minimum of **40 hours per week, Monday through Friday**.