Clinical Data Engineer (Lifesciences) (Hybrid) (Bangalore)

QAAgility Technologies; Bengaluru; Hybride; INR 1 200 000 - 1 800 000; Plein temps

Résumé du poste

QAAgility Technologies in Bengaluru seeks a Clinical Data Engineer to design and maintain scalable data pipelines for lifescience data, focusing on SDTM mappings and data models. The role involves collaboration with clinical SMEs, data scientists, and infrastructure teams to ensure robust, well-documented pipelines.

You will extend existing Databricks pipelines to incorporate Real World Data from registries and EHR sources, aligning rule-based and automated mapping with OMOP interoperability and

Qualifications

• Clinical Data Engineer with lifescience domain expertise.
• Experience creating data pipelines from source to curated data in CDISC SDTM models.
• Proficiency in Databricks-based ETL and data harmonisation.

Responsabilités

• Design, build and maintain production ETL pipelines in Databricks/Delta Lake.
• Map incoming RWD to OMOP and to CDISC SDTM canonical model; handle vocabulary mapping.
• Extend medallion architecture with validation, lineage and performance tuning.
• Develop configurable transformation frameworks driven by config files and catalogs.
• Integrate AI/automation components with human-in-the-loop review.
• Establish testing, CI/CD, monitoring and governance for ETL jobs.
• Collaborate with clinical data scientists and stakeholders to define requirements and success metrics.

Connaissances

Life science domain

SDTM/CDISC/ADaM

Databricks

CI/CD pipeline

R Studio

GitHub

Outils

Databricks

R Studio

GitHub

Description du poste

Job Title - Clinical Data Engineer (Lifescience domain )

Job Type - Hybrid

Experience - 7+ Years

Mandatory skills- Life science domain, SDTM /CDISC/Adam, Databricks, CI/CD pipeline, R studio, Git hub

Person has to collaborate with scientific team

Support data team, process data pipeline efficiently.

Detailed Job Description -

Role summary

We are seeking a highly skilled clinical Data Engineer . You will combine clinical data expertise with strong data engineering and technical skills to generate well documented pipelines from source to curated data sets in common data models like CDISC SDTM. You will collaborate closely with clinical SMEs, data scientists, infrastructure, and other skilled data engineers.

We are looking to expand this functionality to include Real World Data (from a broad range of regristries). You will help extend our medallion Databricks pipelines (CDISC SDTM) to incorporate Real‑World Data (RWD) from registries and other sources, working with clinical experts and AI teams to combine rule‑based and automated mapping approaches (including OMOP interoperability).

Key responsibilities

• Design, build and maintain production ETL pipelines in Databricks/Delta Lake to ingest RWD (registries, claims, EHR extracts) and transform into standard models.
• Implement harmonisation workflows to map incoming RWD to OMOP and to the internal CDISC SDTM canonical model; handle vocabulary mapping, units normalization and provenance.
• Extend the medallion architecture (bronze/silver/gold) patterns with robust validation, lineage, partitioning and performance tuning.
• Develop configurable, inputdriven transformation frameworks so clinical experts can drive mapping rules via config files and catalogs.
• Integrate AI/automation components (e.g., model-assisted mapping, NLP for free text) with humanintheloop review and confidence scoring.
• Establish testing, CI/CD, monitoring and alerting for ETL jobs and automations; ensure reproducibility, versioning and governance.
• Collaborate with clinical data scientists, data stewards and stakeholders to define requirements, data contracts and success metrics.