AI Data Engineer — Research Data Pipelines

Insurance Institute for Business & Home Safety - IBHS; Richburg (SC); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Health plan

Retirement plan

Life insurance

PTO

Family leave

Disability insurance

Training and development

Job summary

IBHS, based in the United States, seeks a Data Engineer, AI Support to translate enterprise needs into scalable data solutions enriching decision-making and operations. You will collaborate with AI researchers and data engineering to prepare data, build pipelines, and evaluate AI/ML workflows.

The role emphasizes responsible AI practices, data quality, reproducibility, and documentation, with opportunities to influence research datasets and tooling across IBHS AI initiatives.

Qualifications

• Bachelor's degree or higher in a quantitative field and hands-on experience building data pipelines for AI/ML workflows.
• Strong Python and SQL skills with experience in data manipulation, exploration, and visualization.
• Familiarity with LLM/VLM data preparation, embedding pipelines, vector databases, semantic search, and reproducible data practices.

Responsibilities

• Prepare, organize, and improve data used across AI research and ML projects.
• Build reliable data workflows moving data from raw sources to usable datasets for analysis and training.
• Ensure datasets are consistent, traceable, and well documented as they evolve over time.
• Automate recurring data preparation tasks to improve research efficiency.
• Develop clear summaries and visualizations to surface data insights and potential issues.

Skills

Python data manipulation

SQL

NoSQL

Data modeling

LLM/VLM datasets

Embedding pipelines

Vector databases

Semantic search

RAG

Metadata retrieval

Graph databases

Data quality

Schema validation

Dataset versioning

Experiment tracking

LLM observability

CI/CD

Terraform

GitHub Actions

Bash scripting

Education

Bachelor's degree in data science, statistics, computer science, mathematics, engineering

Master's degree in data science

Tools

Airflow

Prefect

Dagster

Spark

Azure

AWS

Google Cloud

Label Studio

Prodigy

Job description

IBHS, based in the United States, seeks a Data Engineer, AI Support to translate enterprise needs into scalable data solutions enriching decision-making and operations. You will collaborate with AI researchers and data engineering to prepare data, build pipelines, and evaluate AI/ML workflows.

The role emphasizes responsible AI practices, data quality, reproducibility, and documentation, with opportunities to influence research datasets and tooling across IBHS AI initiatives.