Principal Data Architect - AI-Driven Data Fabric

MediData; Greater London; Hybrid; GBP 120,000 - 180,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Life insurance

Disability insurance

Pension

25+ holidays per year

Job summary

Medidata is seeking a Principal Data Engineer / Architect to lead the strategic vision and hands-on execution of our Object-Centric Data Fabric. You will unify multi-stream clinical datasets with a central semantic layer, leveraging AI-augmented workflows to automate mapping, query optimization, and regulatory documentation.

The role focuses on data lake architecture, AI-enabled schema engineering, and scalable backend services.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, Software Engineering, or equivalent practical experience.
• Extensive experience in enterprise data engineering and architecture.
• Mastery of SQL and cloud data platforms (Snowflake).
• Experience with open data lake structures (Apache Iceberg).
• Proficient in Java/Scala backend services and real-time streaming (Kafka).
• Ability to integrate AI developer tools into workflows to accelerate SQL/code generation.

Responsibilities

• Architect and evolve the enterprise data fabric and data lake strategy centered on Iceberg.
• Develop AI-driven schema inference and mapping artifacts to shorten integration timelines.
• Build scalable real-time ingestion pipelines using Kafka, AWS, and Snowflake.
• Lead data engineering strategy, including CDC, data migration, and performance tuning.
• Incorporate AI inference for telemetry analysis and safety signal mapping.
• Drive TDD/BDD with AI-assisted testing and regulatory documentation generation.
• Ensure data quality and compliance with GxP, HIPAA, GDPR.

Skills

SQL

Snowflake

Java/Scala

Kafka

AI tooling

Regulatory awareness

Education

Bachelor's or Master's degree in Computer Science or related

Tools

Snowflake

Apache Iceberg

AWS

Git

CI/CD

Job description

Medidata is seeking a Principal Data Engineer / Architect to lead the strategic vision and hands-on execution of our Object-Centric Data Fabric. You will unify multi-stream clinical datasets with a central semantic layer, leveraging AI-augmented workflows to automate mapping, query optimization, and regulatory documentation.

The role focuses on data lake architecture, AI-enabled schema engineering, and scalable backend services.