Senior Data Engineer - Databricks & AI Context Pipelines

RADcube; Indianapolis (IN); On-site; USD 90,000 - 130,000; Full time

Job summary

RADcube in Indianapolis, IN is hiring a Data & AI Engineer to design, build, and integrate data pipelines and AI components within a robust AI ecosystem. You will implement business context storage, metadata handling, and reproducible workflows across cloud environments.

You will craft Python-based automations and oversee LLM-assisted workflows with human approvals, monitor pipelines, and deliver reusable code and documentation to client repositories.

Qualifications

• Experience with Python, SQL, data engineering, API integration, ETL/ELT, and cloud services.
• Experience with LLM integrations and RAG workflows.
• Familiarity with agentic AI frameworks, structured and unstructured data, CI/CD, and data governance.

Responsibilities

• Develop and maintain the Business Context Repository in a client approved environment, using the architecture and standards established for the project.
• Build data integration pipelines to capture business context from approved sources, including metadata registries, catalogs, workshop outputs, BI reports, and usage information.
• Implement structured storage and retrieval mechanisms for business definitions, ontology relationships, metadata, business rules, and ground truth datasets.
• Integrate the repository with the client’s existing Context Injection component and relevant Graph, semantic, and metadata services.
• Develop Python based automation to extract, transform, validate, and refresh business context.
• Implement LLM assisted and agentic workflows for context drafting, enrichment, review, and maintenance, including human approval controls.
• Build scheduled refresh processes, staleness detection, logging, and monitoring mechanisms.
• Support development of the AI evaluation runner, execute technical integrations, troubleshoot failures, and maintain deployment configurations.
• Deliver reusable source code, configuration, technical documentation, and operational runbooks to the client’s designated repositories.

Skills

Python

SQL

Data engineering

API integration

ETL/ELT

LLM integrations

RAG

Agentic AI

Structured data

Unstructured data

Cloud services

CI/CD

Data governance

Job description

RADcube in Indianapolis, IN is hiring a Data & AI Engineer to design, build, and integrate data pipelines and AI components within a robust AI ecosystem. You will implement business context storage, metadata handling, and reproducible workflows across cloud environments.

You will craft Python-based automations and oversee LLM-assisted workflows with human approvals, monitor pipelines, and deliver reusable code and documentation to client repositories.