AI Data Engineer

Dell Technologies Inc.; Round Rock (TX); Presencial; USD 120 000 - 170 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health benefits

Resumo da oferta

Dell Technologies is seeking a data engineering professional to build and maintain trusted data foundations that power AI agents. You will design and implement end-to-end pipelines from raw sources to gold data, with provenance tagging and SLA-driven freshness across high-volume workloads.

You will work on entity resolution, model-based extraction lanes, and governance controls, using PySpark, Python, and Spark within lakehouse ecosystems.

Qualificações

• Hands-on data engineering with strong emphasis on correctness and lineage.
• Experience building data pipelines from Bronze to Gold with provenance tagging.
• Familiarity with unstructured content extraction and lakehouse architectures.

Responsabilidades

• Own the medallion data pipeline, ensuring traceable lineage across stages.
• Lead entity resolution to produce a canonical identity for downstream systems.
• Develop model-based extraction lanes to pull structure from HTML, PDF, and assets.
• Ensure provenance and trust with gates and quarantine of failing records.

Conhecimentos

PySpark

Python

Java

SQL

Spark

Data modeling

Data quality

Ferramentas

Databricks

Iceberg

Delta Lake

Airflow

S3

Teradata

Oracle

SingleStore

SQL Server

AWS Step Functions

Descrição da oferta de emprego

Build the data foundation that grounds AI agents on facts they can trust. You turn raw, messy, multi-source data - structured feeds and unstructured content alike - into canonical, provenance-tagged, SLA-fresh Gold data that the Knowledge & Intelligence layer serves. Working with business leaders and internal customers, you set the design standards and assurance processes that keep the pipeline compatible, operable, and traceable end to end. This is hands-on data engineering where correctness and lineage aren't nice-to-haves - they're the product. You develop fundamentally new approaches to pull meaning out of data, and every record you land answers the question “where did this come from, and can we trust it?”

What You'll Own

• The medallion pipeline. Take landed data through Bronze - Silver - Gold - conforming structured sources and extracted content to Gold within its freshness SLA, with traceable lineage at every hop.
• Entity resolution. Own the resolve gate that turns many sources into one canonical identity - the join everything downstream depends on.
• Model-based extraction lanes. Build the NLP- and LLM-assisted lanes that pull structure out of unstructured content across many content types - HTML, PDF, DAM assets, and more - tagged as evidence, not fact.
• Provenance and trust. Tag provenance and trust tier on every record. Quarantine what fails the gate with its reason attached, rather than silently dropping it.
• Performance at scale. Keep high-volume data in the lakehouse - and the served layer - lean and fast.

Why This Role?

• You own the layer everything else is built on. If the grounded facts are right, every agent that reads them is more trustworthy; if they're wrong, nothing downstream can save it - so this is where the leverage really is.
• Genuinely hard, genuinely new work: production-grade extraction from unstructured content, resolution at scale, and lineage you can defend - not another ETL backlog.
• A pod where provenance and trust are first-class engineering concerns, with the mandate to build the gates that enforce them.
• Lakehouse platforms - Databricks, IOMETE, or similar.
• In-depth Spark - massive-volume data processing and fine-tuning.
• PySpark, Java, and Python.
• Table formats - in-depth knowledge of Iceberg, Delta Lake, or similar.
• Advanced querying on RDBMS - complex data retrieval across Teradata, Oracle, SingleStore, and SQL Server.
• Deep understanding of data integrity and consistency.
• Workflow frameworks - Airflow, AWS Step Functions, or similar.
• Chunking, embeddings, and vector databases.
• S3-compatible storage.
• MongoDB - nice to have.

Benefits and Perks of working at Dell Technologies

Your life. Your health. Supported by your benefits. You can explore the overall benefits experience that awaits you as a Dell Technologies team member - right now at MyWellatDell.com