Data Engineer, AI Support

Ibhs

South Carolina

On-site

USD 110,000 - 170,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health Care Plan (Medical, Dental &amp
Retirement Plan (401k, IRA)
Life Insurance (Basic, Voluntary &
Paid Time Off (Vacation, Sick &
Family Leave (Maternity, Paternity)
Disability (Short Term & Long Term)
Training & Development

Job summary

IBHS is seeking a Data Engineer, AI Support to translate enterprise AI needs into scalable data solutions. You will partner with AI researchers and Data Engineering to prepare datasets, build reliable ETL workflows, and ensure data quality and reproducibility across experiments.

You will work in a Linux environment, leverage modern data storage and orchestration tools, and contribute to responsible AI practices while staying current with AI/ML technologies.

Qualifications

  • Bachelor’s degree in data science, statistics, computer science, mathematics, engineering, or related field.
  • Experience building ETL/data pipelines to clean, transform, integrate, and prepare data for AI/ML workflows.
  • Strong Python data manipulation skills and use of vectorized libraries for large-scale data processing.

Responsibilities

  • Prepare, organize, and improve data for AI research and ML projects.
  • Build reliable data workflows moving data from raw sources to usable datasets for analysis, training, and evaluation.
  • Explore datasets, identify quality issues, and determine best data structures for AI use cases.
  • Prepare datasets for AI applications including language, vision, multimodal, and retrieval systems.
  • Ensure datasets are consistent, traceable, reproducible, and well documented over time.
  • Automate recurring data prep tasks to improve research workflow efficiency.
  • Develop summaries and visualizations to help interpret datasets and patterns.
  • Support data integration across research tools, systems, and AI platforms.
  • Protect sensitive information and follow data handling practices throughout data lifecycle.
  • Contribute to an experimental research environment where data and methods evolve.

Skills

Python data manipulation
ETL data pipelines
SQL & NoSQL
LLM/Data prep for AI/ML
Linux/Bash
CI/CD & automation
Data visualization & storytelling

Education

Bachelor’s in data science/CS/math/engineering
Master’s in data science/AI (preferred)

Tools

Airflow
Prefect
Dagster
Langfuse
Weights & Biases
GitHub Actions
Terraform

Job description

About the Role

The Data Engineer, AI Support is a key technical partner in IBHS’s responsible adoption and application of artificial intelligence, machine learning, and advanced analytics. This position translates enterprise-wide needs across IBHS into practical, scalable data solutions that improve decision-making, operational effectiveness, and employee capabilities.

The role combines Data Engineering expertise, solution development, technical consultation, and employee support. It works across business and technical teams to evaluate opportunities, develop and implement solutions, assess performance and risk, and help employees use approved AI-enabled tools effectively.

Why This Role Matters

This role strengthens IBHS’s enterprise-wide ability to use data and artificial intelligence thoughtfully, responsibly, and effectively. By connecting organizational priorities with technical capabilities, the Data Engineer, AI Support helps IBHS identify valuable use cases, improve access to actionable information, and build confidence in AI-enabled solutions.

The position also helps establish consistent practices for solution quality, documentation, data handling, human review, and responsible AI use.

What You'll Do
  • Work closely with AI researchers and Data Engineering to prepare, organize, and improve the data used across research and machine learning projects.
  • Build reliable data workflows that move research data from raw sources into usable datasets for analysis, experimentation, training, and evaluation.
  • Explore and understand new datasets, identify quality issues or gaps, and help determine the best way to structure and use the data.
  • Support the preparation of datasets for a range of AI applications, including language, vision, multimodal, and retrieval-based systems.
  • Help ensure research datasets are consistent, traceable, reproducible, and well documented as they evolve over time.
  • Automate recurring data preparation and processing tasks to make research workflows more efficient and repeatable.
  • Develop clear summaries and visualizations that help the team understand datasets, patterns, and potential issues.
  • Support the integration of data across research tools, internal systems, and AI platforms.
  • Help protect sensitive information and follow appropriate data handling practices throughout the data lifecycle.
  • Contribute to an experimental research environment where datasets, methods, and requirements may change as projects develop.
  • Stay current on relevant developments in artificial intelligence, machine learning, data science, and emerging analytical technologies.
What We're Looking For
  • Bachelor's degree in data science, statistics, computer science, mathematics, engineering, or a related quantitative field.
  • Experience building ETL/data pipelines to clean, transform, integrate, and prepare structured, semi-structured, and unstructured data for AI/ML workflows.
  • Strong Python data manipulation skills, including efficient use of vectorized libraries for large-scale data processing, exploration, and visualization.
  • Working knowledge of SQL, NoSQL, data modeling, columnar formats, and modern data storage technologies.
  • Familiarity with preparing and versioning LLM/VLM training and evaluation datasets, including QA, preference/RL, multimodal, and human-annotated data.
  • Familiarity with embedding pipelines, vector databases, semantic search, RAG, and metadata-aware retrieval workflows.
  • Exposure to graph databases, knowledge graphs, and graph-based data modeling for AI applications.
  • Understanding of data quality, schema validation, dataset versioning, metadata, lineage, and reproducible train/validation/test splits with leakage prevention.
  • Familiarity with distributed data processing and workflow orchestration concepts such as DAGs, task dependencies, scheduling, and pipeline monitoring.
  • Comfortable working in Linux environments with Bash/shell scripting and basic automation.
  • Familiarity with experiment tracking and LLM observability tools such as Weights & Biases and Langfuse.
  • Basic understanding of PII handling, masking, hashing, tokenization, and de-identification within data pipelines.
  • Familiarity with CI/CD and infrastructure automation tools such as GitHub Actions, GitLab CI, and Terraform.
  • Comfortable working with research datasets that may be incomplete, inconsistent, or evolving, and able to investigate the data before implementing a solution.
  • Strong written communication, presentation, and technical-documentation skills.
  • Ability to build effective working relationships across business and technical functions.
  • Ability to exercise sound judgment, manage multiple priorities, and work independently while contributing to cross-functional initiatives.
Preferred Qualifications
  • Master's degree in data science, statistics, computer science, artificial intelligence, machine learning, or a related field.
  • Experience supporting AI/ML research, scientific computing, or other data-intensive research environments.
  • Hands-on experience with cloud data platforms or services in Azure, AWS, or Google Cloud.
  • Experience with data orchestration and distributed processing tools such as Airflow, Prefect, Dagster, Spark, or similar technologies.
  • Familiarity with data annotation and human-in-the-loop platforms such as Label Studio or Prodigy, particularly for machine learning or multimodal datasets.
Note: IBHS welcomes applications from all qualified candidates who are legally authorized to work in the United States. Employment visa sponsorship is not available for this position. Candidates who require IBHS sponsorship for an employment visa, now or in the future, will not be considered for this role.
  • Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k, IRA)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Paid Time Off (Vacation, Sick & Public Holidays)
  • Family Leave (Maternity, Paternity)
  • Short Term & Long Term Disability
  • Training & Development
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer, AI Support
Data Engineer, AI Support

Insurance Institute for Business and Home Safety • Richburg (SC)

On-site
USD 100,000 - 150,000
Health Care Plan (Medical, Dental &amp
Retirement Plan (401k, IRA)
Life Insurance
+4
Data Engineer, AI Support
Data Engineer, AI Support

Insurance Institute for Business & Home Safety - IBHS • Richburg (SC)

On-site
USD 120,000 - 170,000
Health plan
Retirement plan
Life insurance
+4
Data Engineer, AI Support
Data Engineer, AI Support

Insurance Institute for Business & Home Safety • Richburg (SC)

On-site
USD 110,000 - 190,000
Health Plan
401k/IRA
Life Insurance
+4
AI Data Engineer
AI Data Engineer

Howard Hughes Medical Institute • Chevy Chase (MD)

Hybrid
USD 129,000 - 161,000
Hiring pay range: $128,816.80 - $161,0
Competitive pay
Exceptional health benefits
+3
Senior Data Engineer - AI Infrastructure Integration, High Performance Compute
Senior Data Engineer - AI Infrastructure Integration, High Performance Compute

Bank of America • Jersey City (NJ)

On-site
USD 128,000 - 182,000
Benefits eligible
Senior Data Engineer - AI Infrastructure Integration, High Performance Compute
Senior Data Engineer - AI Infrastructure Integration, High Performance Compute

HITEC • Jersey City (NJ)

On-site
USD 141,000 - 205,000
AI Data Engineer
AI Data Engineer

ProSearch • United States

Remote
USD 90,000 - 120,000
Lead Data Engineer – AI/Machine Learning
Lead Data Engineer – AI/Machine Learning

Core Specialty • Cincinnati (OH)

Hybrid
USD 150,000 - 210,000
Medical, dental, vision, and life ins.
Disability insurance
401(k) company-match
+5
Senior Data Scientist III
Senior Data Scientist III

LexisNexis • United States

Hybrid
USD 120,000 - 150,000
401(k) with match
Wellness platform
Short-and-Long Term Disability
+1
AI Data Engineer — Research Data Pipelines
AI Data Engineer — Research Data Pipelines

Insurance Institute for Business & Home Safety - IBHS • Richburg (SC)

On-site
USD 120,000 - 170,000
Health plan
Retirement plan
Life insurance
+4