Senior Data Engineer - AI-Powered Health Data Platform

Intellias; Portugal; Presencial; EUR 70.000 - 95.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Health Insurance

Modern Porto office

Descripción de la vacante

Intellias is seeking a Senior Data Engineer to own data ingestion and processing for a large-scale health data platform. You will transform fragmented provider data into standardized FHIR resources and ensure data quality end-to-end, while building AI-powered, cloud-native solutions.

You will work with Python, Spark, Prefect, AWS, Kubernetes, MongoDB, and OpenSearch, solving complex data challenges in healthcare interoperability and PHI/PII protection.

Formación

• 5+ years of professional experience building and operating data-intensive backend or data engineering systems at scale.
• Production-grade data processing and backend services in Python.
• Designing scalable data ingestion and ETL/ELT pipelines for large, heterogeneous datasets.
• Data modeling, storage design, schema evolution, query optimization, caching strategies.

Responsabilidades

• Design, build, and operate scalable data ingestion pipelines from diverse healthcare data sources.
• Transform data into standardized, trusted models including FHIR-native resources.
• Own data quality end-to-end with validation rules and monitoring.
• Implement entity resolution, deduplication, and data enrichment solutions.
• Build distributed data processing pipelines using Python, Spark, and orchestration tech.
• Improve pipeline reliability, observability, and onboarding of new data sources.
• Establish data governance standards and validation workflows.
• Operate storage and search solutions for large-scale healthcare datasets.
• Develop AI-powered data tooling to enhance processing workflows.
• Use AI development tools to accelerate engineering lifecycle and data analysis.
• Own production operations including monitoring and incident response.
• Collaborate with Analytics/Data Science to develop data quality dashboards.

Conocimientos

Python

Data engineering

Distributed data processing

Data modeling

Schema design

ETL/ELT pipelines

Spark

Prefect/Airflow

AWS

Docker/Kubernetes

Data quality

Entity resolution

OpenSearch/MongoDB

AI-enabled data pipelines

Educación

Bachelor’s degree in Computer Science or related field

ML/AI exposure (beneficial)

Herramientas

Apache Spark

Databricks

Descripción del empleo

Intellias is seeking a Senior Data Engineer to own data ingestion and processing for a large-scale health data platform. You will transform fragmented provider data into standardized FHIR resources and ensure data quality end-to-end, while building AI-powered, cloud-native solutions.

You will work with Python, Spark, Prefect, AWS, Kubernetes, MongoDB, and OpenSearch, solving complex data challenges in healthcare interoperability and PHI/PII protection.