Senior Big Data Engineer — Healthcare Data on Databricks

IQVIA; Warszawa; On-site; PLN 189,000 - 350,000; Full time

Benefits offered by this job

Offices in 100+ countries

Multi-terabyte databases

Technical training

Conference participation

Competitive benefits

Job summary

IQVIA in Warsaw is seeking a Senior Big Data Engineer to design, develop and support data pipelines for healthcare data at scale, processing millions of records.

You will own delivery of end-to-end ETL on Databricks, collaborate with architects and QA, and guide junior engineers in an Agile environment.

The role requires strong SQL, Python and Scala skills, Azure Cloud experience, and a passion for building robust data platforms.

Qualifications

• 6+ years of data engineering experience.
• Proficient in SQL, Python and Scala with 6+ years in each.
• Strong understanding of Databricks platform and Azure Cloud Services.
• Experience with Big Data batch processing and CI/CD automation (Jenkins/GitLab).
• Hands-on with Apache Spark ecosystem, Delta and Parquet formats.
• Experience with healthcare or pharmaceutical data is a plus.
• Familiarity with Agile environments.

Responsibilities

• Oversee and mentor junior and mid-level engineers.
• Delegate tasks with clear expectations.
• Own delivery of assigned workstreams with quality and timeliness.
• Build pipelines for processing large volumes of medical data.
• Participate in design, development, deployment and maintenance.
• Conduct peer code reviews.
• Define and adopt technical standards.
• Create comprehensive automated tests.

Skills

SQL

Python

Scala

Databricks

Azure Cloud Services

Big Data

ETL design

CI/CD (Jenkins/GitLab)

FastAPI

Agile/Scrum

Data profiling

Tools

Jenkins

GitLab

Delta lake

Parquet

FastAPI

Job description

IQVIA in Warsaw is seeking a Senior Big Data Engineer to design, develop and support data pipelines for healthcare data at scale, processing millions of records.

You will own delivery of end-to-end ETL on Databricks, collaborate with architects and QA, and guide junior engineers in an Agile environment.

The role requires strong SQL, Python and Scala skills, Azure Cloud experience, and a passion for building robust data platforms.