Staff Data Engineer (healthcare solution)

Intellias; Polska; In loco; PLN 200.000 - 320.000; Tempo pieno

Descrizione del lavoro

Intellias is seeking a Staff Healthcare Data Engineer to lead the technical direction of a large-scale FHIR-based health data platform. You will own end-to-end data pipelines, ingest diverse healthcare data, ensure data quality and PHI-safe processing, and drive architectural standards across teams.

The role combines hands-on data engineering with broad technical influence, including design reviews, mentoring, and applying AI-native approaches to accelerate delivery while maintaining stringent

Competenze

• 8+ years of professional experience in data engineering, HealthTech, or healthcare interoperability.
• Staff-level technical ownership of complex production systems across multiple components and teams.
• Strong hands-on Python programming and production-grade data engineering.
• Deep experience with Spark/PySpark at scale, including performance tuning and distributed processing.
• Experience with Databricks and Delta Lake, or comparable lakehouse platforms.
• Designing and operating large-scale ETL/ELT pipelines (CDC, delta, idempotency, schema evolution).
• Proven ability to diagnose performance and scalability bottlenecks in distributed data systems.
• Deep hands-on experience with FHIR R4, resources, profiles, bundles, validation, and large-scale data transformation.
• Strong knowledge of US Core, USCDI, HL7 v2.x, and healthcare terminology (SNOMED CT, LOINC, RxNorm).
• Experience with healthcare data models (clinical, claims, coverage, eligibility).
• Data quality, deduplication, record/patient linking, terminology normalization, and validation.
• Strong SQL, data modeling, and production data architecture understanding.
• Experience with Git, CI/CD, automated testing, observability, and production operations.
• Understanding of healthcare security, privacy, and PHI-safe engineering (HIPAA).
• Ability to establish reusable engineering frameworks and standards adopted by teams.
• Mentoring senior/mid engineers and influencing cross-team engineering.

Mansioni

• Set technical direction for healthcare data engineering across ingestion, transformation, validation, normalization, and delivery.
• Own end-to-end architecture of large-scale distributed data pipelines transforming heterogeneous source data into clean, FHIR-conformant data.
• Design and evolve scalable solutions using Python, Spark, Databricks/Delta Lake, and modern data-processing tech.
• Diagnose and eliminate complex performance and scalability bottlenecks across distributed data workloads.
• Establish standards and reusable frameworks for data quality, deduplication, patient/record linking, terminology normalization, and idempotent processing.
• Define architectural patterns for FHIR transformation, validation, schema evolution, and production delivery.
• Build and evolve automated testing and validation capabilities for data quality and FHIR conformance.
• Establish engineering patterns and tooling to accelerate delivery of healthcare data capabilities.
• Champion PHI-safe engineering practices and ensure security, privacy, and compliance.
• Make AI-native engineering a practical part of development with coding agents and reusable AI capabilities.
• Establish guardrails for AI-assisted development ensuring correctness, testing, security, and observability.
• Mentor engineers through design reviews, pairing, and knowledge sharing.

Conoscenze

Python

Spark / PySpark

Databricks

Delta Lake

FHIR R4

HL7 v2.x

US Core / USCDI

SNOMED CT / LOINC / RxNorm

Data quality / deduplication

Record linking / identity resolution

Production data pipelines

HIPAA compliance

AI-native engineering

Git / CI/CD / automated testing

Strumenti

Databricks Platform

CI/CD tooling

Descrizione del lavoro

• Intellias is looking for a Staff Healthcare Data Engineer to join a large-scale digital healthcare initiative focused on building a FHIR-based health data platform and transforming fragmented healthcare data into clean, standardized, and trustworthy information.
• This is a Staff-level Individual Contributor role combining deep healthcare data engineering expertise, distributed data systems, FHIR interoperability, and AI-native software development. You will set technical direction for how healthcare data is ingested, transformed, validated, and delivered at scale while solving the platform’s most complex engineering and data-quality challenges.
• The role requires both deep hands-on engineering expertise and broad technical influence — establishing reusable frameworks and standards, mentoring experienced engineers, and raising the engineering bar across the team.
• The project is building a FHIR-based healthcare data platform at scale, integrating information from EHRs, healthcare organizations, payer systems, national and reference datasets, and other clinical data sources.
• The platform transforms heterogeneous healthcare data into clean, standards-conformant FHIR while addressing complex challenges around data quality, patient and record matching, deduplication, terminology normalization, distributed processing, and reliable delivery at production scale.
• The technology landscape includes Python, Apache Spark/PySpark, Databricks, Delta Lake, SQL, FHIR R4, HL7, C-CDA, healthcare terminology standards, and modern cloud-native data infrastructure.
• This is an AI-native engineering environment where coding agents such as Claude Code and reusable AI capabilities are integrated into the engineering lifecycle. AI is used to accelerate development and solve appropriate healthcare data problems while maintaining strict standards for correctness, deterministic processing, testing, security, and PHI safety.

Requirements:

• 8+ years of professional experience in data engineering, healthcare data platforms, HealthTech, or healthcare interoperability.
• Proven Staff-level technical ownership of complex production systems, including the ability to set technical direction and solve problems spanning multiple components and engineering teams.
• Strong hands-on expertise in Python and production-grade data engineering.
• Deep experience with Apache Spark/PySpark at scale, including partitioning, performance optimization, memory tuning, and distributed processing.
• Experience with modern lakehouse technologies such as Databricks and Delta Lake, or comparable platforms.
• Strong experience designing and operating large-scale ETL/ELT pipelines, including CDC, incremental/delta processing, idempotency, schema evolution, and batch/streaming workloads.
• Proven experience diagnosing and eliminating complex performance and scalability bottlenecks in distributed data-processing systems.
• Deep hands‑on experience with FHIR R4, including resources, profiles, Bundles, validation, and large‑scale healthcare data transformation.
• Strong knowledge of US Core, USCDI, HL7 v2.x, and C-CDA-to-FHIR transformation patterns.
• Strong understanding of healthcare terminology standards including SNOMED CT, LOINC, and RxNorm.
• Experience working with clinical, claims, coverage, eligibility, or comparable healthcare data models.
• Strong experience with data quality, deduplication, record/patient linking, terminology normalization, and validation.
• Strong SQL skills and understanding of data modeling, schema evolution, data quality, and production data architecture.
• Experience with Git, CI/CD, automated testing, observability, and production operations.
• Strong understanding of healthcare security, privacy, and regulatory requirements, including HIPAA and PHI‑safe engineering practices.
• Proven ability to establish reusable engineering frameworks, architectural patterns, standards, and data‑quality practices adopted by other engineers.
• Demonstrated technical leadership through architecture/design reviews, mentoring, pairing, and cross‑team engineering influence.
• Practical experience using AI coding agents such as Claude Code or comparable agentic engineering tools as an integral part of the development lifecycle.
• Strong engineering judgment around when to use AI/LLM-based approaches versus deterministic rule‑based solutions, particularly where correctness, cost, performance, or PHI safety are critical.
• Professional English sufficient for direct collaboration with U.S.-based technical and business stakeholders.

Nice to Have

• Deep experience with large-scale FHIR data modeling and healthcare interoperability platforms.
• Experience with Master Patient Index (MPI), patient matching, identity resolution, or large-scale record linkage.
• Experience with payer data exchange, including CARIN Blue Button, Da Vinci implementation guides, or similar standards.
• Experience working with pharmacy, laboratory, or other specialized healthcare datasets.
• Knowledge of ICD-10, CPT, CVX, and additional clinical terminology/code systems.
• Experience with 21st Century Cures Act, ONC certification, CMS Interoperability Rule, or related U.S. healthcare regulatory frameworks.
• Experience building LLM/agent-based capabilities for clinical data extraction, normalization, terminology mapping, or healthcare data quality.
• Experience designing reusable AI skills or agentic workflows adopted across engineering teams.
• Contributions to open-source healthcare, FHIR/HL7 communities, or relevant industry working groups.

Responsibilities:

• Set the technical direction for healthcare data engineering across ingestion, transformation, validation, normalization, and delivery.
• Own the end-to-end architecture of large-scale distributed data pipelines transforming heterogeneous source data into clean, standards-conformant FHIR.
• Design and evolve scalable solutions using Python, Spark/PySpark, Databricks/Delta Lake, and modern data-processing technologies.
• Diagnose and eliminate complex performance and scalability bottlenecks across distributed data workloads.
• Establish standards and reusable frameworks for data quality, deduplication, patient/record linking, terminology normalization, and reliable idempotent processing.
• Define architectural patterns for FHIR transformation, validation, schema evolution, and production delivery.
• Build and evolve automated testing and validation capabilities for data quality and FHIR conformance.
• Establish engineering patterns and reusable tooling that allow the broader team to deliver new healthcare data capabilities faster and more consistently.
• Champion PHI-safe engineering practices and ensure healthcare data solutions meet applicable security, privacy, and compliance requirements.
• Make AI-native engineering a practical part of the team's development model, using coding agents and reusable AI capabilities to automate repetitive work and accelerate complex engineering tasks.
• Establish engineering guardrails for AI-assisted development, ensuring AI-generated solutions remain correct, tested, secure, observable, and PHI-safe.
• Determine where deterministic processing provides better reliability than AI/LLM-based approaches and establish appropriate architectural patterns for both.
• Mentor Senior and Middle engineers through design reviews, pairing, technical guidance, and knowledge sharing.
• Drive complex, ambiguous engineering problems from initial investigation through architecture, implementation, and production operation.
• Collaborate with engineering, product, security, data, and healthcare-domain stakeholders to translate complex interoperability requirements into scalable technical solutions.
• Represent strong healthcare data engineering practices in relevant architecture, standards, and technical discussions.

Why this position:

• This role offers the opportunity to set the technical direction for healthcare data engineering on a FHIR platform operating at scale.
• As a Staff-level Individual Contributor, your impact extends well beyond individual pipelines or services. You will own some of the platform's hardest engineering problems, establish reusable frameworks and standards, and influence how an entire engineering team builds, validates, and operates healthcare data solutions.
• The technical scope combines large-scale distributed data engineering, FHIR/HL7 interoperability, healthcare terminology, data quality, cloud data platforms, and AI-native engineering.
• AI is a core part of the engineering model rather than an experimental add-on. You will help determine how coding agents and reusable AI capabilities can increase engineering leverage while maintaining the rigor required for production healthcare systems and PHI-sensitive data.
• This is a hands-on Staff IC position: you will set direction and mentor engineers, but your technical authority comes from remaining deeply involved in architecture, implementation, performance optimization, and production problem solving.