Data Engineer (SAP)

Lumenalta; Colombia; A distancia; COP 388.425.000 - 582.637.000; Jornada completa

Descripción de la vacante

Lumenalta is seeking a seasoned Data Engineer to design and run SAP-to-Databricks pipelines. You will work with ECC/S/4HANA data, map core finance, sales, materials, and supply chain tables, and land clean Delta tables.

You will implement incremental and CDC patterns, validate deltas, and reconcile Databricks outputs with SAP. The role is fully remote, but requires strong English communication and collaboration with client teams.

Formación

• 5+ years in data engineering with production pipelines on Databricks.
• Hands-on SAP data extraction (ECC or S/4HANA) and familiarity with core tables/modules.
• Strong PySpark/SQL skills and experience with Delta Lake.
• Experience with SAP extraction approaches (ODP, BW extractors, SLT, SAP Datasphere).

Responsabilidades

• Build ingestion pipelines for SAP data landing in Databricks.
• Model SAP data and land in Delta tables via PySpark and SQL.
• Implement incremental and CDC patterns and validate deltas.
• Reconcile outputs against SAP and ensure accuracy.
• Document reusable patterns and runbooks.
• Collaborate with client engineering teams in their tools.

Conocimientos

Databricks pipelines

PySpark

SQL

Delta Lake

CDC ingestion

SAP data extraction

English fluency

Herramientas

ODP

BW extractors

SLT

SAP Datasphere

Delta Live Tables

Auto Loader

Databricks Workflows

Descripción del empleo

We partner with global enterprises to design and build large-scale data platforms that power the products and operations at the center of their business. This engagement supports a major US consumer goods company that is moving its SAP data into Databricks.

The client has defined an ingestion architecture for SAP source data landing in Databricks. The question now is whether that architecture holds up as a repeatable delivery method for the SAP data domains that come next. Your job is to put it to work against real SAP data and find out.

What You'll Do

• Build ingestion pipelines for SAP source data landing in Databricks, following the client-defined ingestion architecture.
• Work with SAP table structures, relationships, and business objects to land data correctly and completely.
• Implement incremental and change-data-capture patterns for SAP sources, and validate that deltas are applied accurately.
• Transform landed SAP data into clean, usable Delta tables using PySpark, SQL, and Databricks declarative pipelines.
• Reconcile Databricks outputs against SAP to confirm completeness and accuracy.
• Identify gaps, performance issues, and failure points in the ingestion architecture, and propose practical improvements.
• Document reusable patterns, configurations, and runbooks so the approach can be repeated for subsequent SAP data domains.
• Work directly with the client's engineering and data teams in their tools and environments, adapting to their priorities as they shift.

What We're Looking For

• 5+ years in data engineering, including production pipelines on Databricks.
• Hands-on experience extracting and modeling SAP data from ECC or S/4HANA, including familiarity with core SAP tables and modules such as finance, sales, materials, or supply chain.
• Experience with SAP extraction approaches, such as ODP or BW extractors, SLT, SAP Datasphere, or third-party replication tools.
• Experience implementing incremental and CDC ingestion patterns.
• Strong PySpark and SQL, and working knowledge of Delta Lake.
• Experience with Databricks declarative pipelines or Delta Live Tables, Auto Loader, and Databricks Workflows.
• Comfortable working in a client-directed, time-and-materials model, where priorities are set by the client and can change week to week.
• Clear written communication, with the discipline to document patterns so others can reuse them.
• Fluent English, both written and spoken.

Nice to Have

• Experience with SAP Business Data Cloud or SAP Databricks.
• Experience with Unity Catalog, including organizing and governing SAP-derived data.
• Prior SAP-to-cloud migration work in consumer goods, manufacturing, or distribution.
• Databricks Data Engineer Professional certification.

Why Lumenalta is an amazing place to work at

At Lumenalta, you can expect that you will:

• Be 100% dedicated to one project at a time so that you can innovate and grow.
• Be a part of a team of talented and friendly senior-level developers.
• Work on projects that allow you to use leading tech.

For Databricks practitioners specifically, we are a Databricks partner with Champions and MVPs on our team, and that carries three concrete things:

• Delivery Partner Program qualification. Databricks co-delivers its Professional Services engagements through a short list of approved partner organizations, and practitioners have to be individually qualified before they can work on them. The qualification is granted once at the individual level and does not expire, so it stays with you. Partner organizations are the route in, so the qualified pool stays small. That scarcity is most of the value, and we sponsor it.
• Champion path. Databricks Champion is an individual recognition with its own badge, a dedicated Databricks solutions architect as your mentor, access to product teams, confidential roadmap briefings, and an invitation to the internal Tech Summit. Nomination has to come from a partner organization, which puts it out of reach for independents and most contractors. We nominate actively and regularly, and the Champions already on our team mentor candidates through it.
• Certifications covered. We pay the exam fee for any Databricks certification you want to take.

Our Process

A screening call, a technical interview, and a HackerRank assessment. The technical interview is a conversation rather than a whiteboard exam. We will ask you to walk through an SAP-to-cloud pipeline you built, how you extracted and modeled the SAP data, how you handled deltas and reconciliation, and what you would change. Relevant project experience matters more to us than certifications.

Location:

This is a fully remote position; however, candidates must be based in regions that align with the Pacific, Central, or Eastern U.S. time zones to ensure effective collaboration with client and team schedules.

Application Deadline

Applications will be accepted until October 25th, 2026. Candidates can expect feedback by November 2nd, 2026.