AI Data Engineer: Build Responsible Analytics Pipelines

Insurance Institute for Business and Home Safety; Richburg (SC); On-site; USD 100,000 - 150,000; Full time

Benefits offered by this job

Health Care Plan (Medical, Dental &amp

Retirement Plan (401k, IRA)

Life Insurance

Paid Time Off

Family Leave

Disability insurance

Training & Development

Job summary

Insurance Institute for Business and Home Safety seeks a Data Engineer, AI Support to architect and operationalize data pipelines and AI-ready datasets for ML research and development. You’ll collaborate with AI researchers and data engineers to translate enterprise needs into scalable data solutions, ensuring quality and governance across the data lifecycle.

The role emphasizes responsible AI practices, documentation, and reproducible experiments while enabling researchers to derive actionable

Qualifications

• Bachelor's degree in data science, statistics, computer science, mathematics, engineering, or a related quantitative field.
• Experience building ETL/data pipelines for AI/ML workflows.
• Strong Python data manipulation and large-scale processing skills.
• Working knowledge of SQL, NoSQL, data modeling and modern storage tech.
• Familiarity with LLM/VLM training data preparation and evaluation.
• Experience with vector databases, semantic search, and retrieval workflows.
• Familiarity with CI/CD and infra automation tools like GitHub Actions or Terraform.
• Ability to work in Linux with Bash and automation basics.
• Excellent written communication and cross-functional collaboration.

Responsibilities

• Prepare, organize, and improve data used across research and ML projects.
• Build reliable data workflows moving raw data into usable datasets.
• Identify data quality issues and structure data for AI/ML use cases.
• Prepare datasets for NLP, vision, multimodal, and retrieval systems.
• Ensure datasets are consistent, traceable, and well documented.
• Automate recurring data preparation tasks for repeatable workflows.
• Develop summaries and visualizations to reveal data patterns and issues.
• Support data integration across tools, systems, and AI platforms.
• Protect sensitive information and follow data handling practices.
• Contribute to an experimental research environment with evolving datasets.
• Stay current on AI/ML developments and analytics technologies.

Education

Bachelor's degree in a quantitative field

Master's degree in data science / AI/ ML

Tools

Airflow

Dagster

Spark

Terraform

GitHub Actions

GitLab CI

Langfuse

Weights & Biases

Label Studio

Prodigy

Job description

Insurance Institute for Business and Home Safety seeks a Data Engineer, AI Support to architect and operationalize data pipelines and AI-ready datasets for ML research and development. You’ll collaborate with AI researchers and data engineers to translate enterprise needs into scalable data solutions, ensuring quality and governance across the data lifecycle.

The role emphasizes responsible AI practices, documentation, and reproducible experiments while enabling researchers to derive actionable