Data Engineer

Talentify; Indianapolis (IN); Remote; USD 120,000 - 170,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

PTO accrual

Paid holidays

Referral program

Job summary

Theoris Services is seeking a Data Engineer to support a Clinical Trial Foundations engagement focused on making domain datasets AI-ready. You will build and maintain ETL/ELT pipelines, design data models, and embed data quality and lineage to ensure reliable AI inputs.

This role intersects data engineering with domain evaluation, documenting schema, and capturing stakeholder questions. Ideal candidates have hands-on clinical development or regulatory data experience and are adept at translating

Qualifications

• Direct clinical data experience (clinical development, medical affairs, pharmacovigilance, or regulatory data).
• Strong documentation habits for schema, metadata, and evaluation sets.
• Ability to translate stakeholder questions into structured data requirements.
• Experience building AI/LLM evaluation frameworks and data readiness checks.

Responsibilities

• Build and maintain ETL/ELT pipelines and data models for AI-ready datasets.
• Design data models supporting availability, performance, and reuse for AI querying.
• Embed data quality checks, lineage, and governance for reliable AI inputs.
• Audit data products to document schema, definitions, and data types.

Skills

Clinical domain experience

Documentation

Stakeholder communication

Data quality controls

Tools

Claude or similar models

Job description

Job Title: Data Engineer - Clinical Trial Foundations (AI Readiness)

Location: Remote

Industry: Pharmaceutical / Clinical Development

Job Description: Theoris Services is assisting our client in their search for a Data Engineer to support a Clinical Trial Foundations engagement focused on making domain datasets AI-ready. Our client is seeking an individual with hands on clinical development, medical affairs, pharmacovigilance, or regulatory data experience to build and maintain pipelines and data models, embed data quality, and prepare clinical datasets so AI systems can answer business questions accurately. This role sits at the intersection of data engineering and domain evaluation: documenting schema and metadata, capturing stakeholder questions, establishing ground truth, and iterating on data readiness based on how models (including Claude) perform against those datasets.

Responsibilities

• Build and maintain ETL/ELT pipelines and support infrastructure for Clinical Trial Foundations datasets.
• Design and implement data models that support availability, performance, and reuse for AI querying.
• Embed data quality checks, performance considerations, and lineage so datasets are reliable inputs for downstream AI use.
• Audit existing data products to document schema, field definitions, data types, and business meaning.
• Identify gaps where schema or metadata is missing, inconsistent, or undocumented - a primary blocker to AI readiness.
• Tag datasets with sensitivity and classification levels (PII, GxP-regulated, public, and related categories).
• Work directly with business stakeholders to capture the specific questions they want the data to answer.
• Translate ambiguous business asks into structured, testable questions a dataset should be able to support.
• Maintain a living inventory that maps datasets to the business questions they support or should support.
• Establish ground truth answers and values for representative business questions per dataset.
• Design evaluation sets (question and correct-answer pairs) to test whether AI systems querying the data return accurate results.
• Identify and document known data quality issues, edge cases, and limitations that could cause inaccurate AI responses.
• Use Claude (or similar models) to generate responses and insights against datasets, then evaluate those responses against ground truth.
• Score and categorize failure modes (hallucination, stale data, misinterpreted schema, wrong aggregation logic, and related issues).
• Iterate on metadata and schema documentation based on where model responses fail, and feed those fixes back into dataset AI-readiness.
• Build repeatable evaluation rubrics and scorecards that can scale across the domain’s datasets.
• Document metadata, ground truth sets, and evaluation results centrally so other teams do not repeat the work.

Requirements

• Direct experience in Clinical Trial Foundations or related clinical development domains, including protocols, clinical trial data, regulatory submissions, or medical affairs. Clinical, medical, pharmacovigilance, or regulatory data background is strongly preferred over general data engineering experience alone.
• Working knowledge of clinical and medical data standards (for example CDISC, SDTM, MedDRA) and GxP-regulated data handling.
• Familiarity with pharmacovigilance, safety, or regulatory reporting data flows.
• Experience building ETL/ELT pipelines, data models, and data quality controls, with designs oriented toward data availability for AI.
• Experience building AI/LLM evaluation frameworks (for example with Claude or similar models) against domain-specific datasets.
• Ability to translate clinical and medical stakeholder questions into structured, testable data requirements.
• Strong documentation habits for schema, metadata, evaluation sets, and reusable scorecards.

Best-In-Class-Benefits

We are in the people business; treating people right is our ONLY priority. Theoris Services consultants are full-time employees with full benefits, including:

• Robust Health Insurance
• 401(k) plan
• PTO accrual
• Paid holidays
• Excellent cash-based referral program

About Theoris

Our goal is to Fuel Your Career! As a Theoris team member, you join a culture based on people-centered values and an environment that fosters both personal and professional growth. We build long-term relationships with our clients and our consultants. With over 30 years of building strong relationships in the industry, we’re uniquely positioned to make the right connections. This knowledge is used to find the right job placement. Our recruiting teams are experts dedicated to the information technology and engineering staffing space and are highly respected by our client base.