AI Data Engineer for Research Data Pipelines

Ibhs; Northern (KY, SC); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health Insurance

401k/IRA

Life Insurance

Paid Time Off

Family Leave

Disability

Training & Development

Job summary

IBHS is seeking a Data Engineer, AI Support to translate enterprise needs into scalable data solutions for AI/ML initiatives. You will work with AI researchers and Data Engineering to prepare data, build pipelines, and automate processes to support language, vision, multimodal and retrieval-based AI applications.

Responsibilities include ensuring data quality, lineage, and documentation while enabling efficient experimentation and adoption of approved AI tools across the organization.

Qualifications

• Bachelor's degree in a quantitative field (data science, CS, math, engineering).
• Experience building ETL/data pipelines for AI/ML workflows.
• Strong Python data manipulation and large-scale data processing.
• Knowledge of SQL/NoSQL, data modeling, and modern storage.
• Experience with LLM/VLM data prep, QA, and multimodal datasets.
• Familiarity with embedding pipelines, vector databases, and semantic search.

Responsibilities

• Prepare, organize, and improve data used across research and ML projects.
• Build reliable data workflows moving data from raw sources to usable datasets.
• Expose data quality checks, lineage, and documentation for reproducibility.
• Automate recurring data prep tasks to improve efficiency of research workflows.
• Create summaries and visualizations to help interpret datasets and patterns.
• Support data integration across research tools, systems, and AI platforms.
• Protect sensitive information and follow data-handling practices.

Skills

Python

SQL/NoSQL

ETL pipelines

Data modeling

LLM data prep

Vector databases

Education

Bachelor's degree

Master's degree (preferred)

Tools

Airflow

Spark

GitHub Actions

Terraform

Langfuse

Job description

IBHS is seeking a Data Engineer, AI Support to translate enterprise needs into scalable data solutions for AI/ML initiatives. You will work with AI researchers and Data Engineering to prepare data, build pipelines, and automate processes to support language, vision, multimodal and retrieval-based AI applications.

Responsibilities include ensuring data quality, lineage, and documentation while enabling efficient experimentation and adoption of approved AI tools across the organization.