AI Data Engineer for Research & ML Pipelines

Ibhs; South Carolina; On-site; USD 110,000 - 170,000; Full time

Benefits offered by this job

Health Care Plan (Medical, Dental &amp

Retirement Plan (401k, IRA)

Life Insurance (Basic, Voluntary &

Paid Time Off (Vacation, Sick &

Family Leave (Maternity, Paternity)

Disability (Short Term & Long Term)

Training & Development

Job summary

IBHS is seeking a Data Engineer, AI Support to translate enterprise AI needs into scalable data solutions. You will partner with AI researchers and Data Engineering to prepare datasets, build reliable ETL workflows, and ensure data quality and reproducibility across experiments.

You will work in a Linux environment, leverage modern data storage and orchestration tools, and contribute to responsible AI practices while staying current with AI/ML technologies.

Qualifications

• Bachelor’s degree in data science, statistics, computer science, mathematics, engineering, or related field.
• Experience building ETL/data pipelines to clean, transform, integrate, and prepare data for AI/ML workflows.
• Strong Python data manipulation skills and use of vectorized libraries for large-scale data processing.

Responsibilities

• Prepare, organize, and improve data for AI research and ML projects.
• Build reliable data workflows moving data from raw sources to usable datasets for analysis, training, and evaluation.
• Explore datasets, identify quality issues, and determine best data structures for AI use cases.
• Prepare datasets for AI applications including language, vision, multimodal, and retrieval systems.
• Ensure datasets are consistent, traceable, reproducible, and well documented over time.
• Automate recurring data prep tasks to improve research workflow efficiency.
• Develop summaries and visualizations to help interpret datasets and patterns.
• Support data integration across research tools, systems, and AI platforms.
• Protect sensitive information and follow data handling practices throughout data lifecycle.
• Contribute to an experimental research environment where data and methods evolve.

Skills

Python data manipulation

ETL data pipelines

SQL & NoSQL

LLM/Data prep for AI/ML

Linux/Bash

CI/CD & automation

Data visualization & storytelling

Education

Bachelor’s in data science/CS/math/engineering

Master’s in data science/AI (preferred)

Tools

Airflow

Prefect

Dagster

Langfuse

Weights & Biases

GitHub Actions

Terraform

Job description

IBHS is seeking a Data Engineer, AI Support to translate enterprise AI needs into scalable data solutions. You will partner with AI researchers and Data Engineering to prepare datasets, build reliable ETL workflows, and ensure data quality and reproducibility across experiments.

You will work in a Linux environment, leverage modern data storage and orchestration tools, and contribute to responsible AI practices while staying current with AI/ML technologies.