Senior Big Data Engineer

IQVIA; Warszawa; On-site; PLN 189,000 - 350,000; Full time

Benefits offered by this job

Offices in 100+ countries

Multi-terabyte databases

Technical training

Conference participation

Competitive benefits

Job summary

IQVIA in Warsaw is seeking a Senior Big Data Engineer to design, develop and support data pipelines for healthcare data at scale, processing millions of records.

You will own delivery of end-to-end ETL on Databricks, collaborate with architects and QA, and guide junior engineers in an Agile environment.

The role requires strong SQL, Python and Scala skills, Azure Cloud experience, and a passion for building robust data platforms.

Qualifications

• 6+ years of data engineering experience.
• Proficient in SQL, Python and Scala with 6+ years in each.
• Strong understanding of Databricks platform and Azure Cloud Services.
• Experience with Big Data batch processing and CI/CD automation (Jenkins/GitLab).
• Hands-on with Apache Spark ecosystem, Delta and Parquet formats.
• Experience with healthcare or pharmaceutical data is a plus.
• Familiarity with Agile environments.

Responsibilities

• Oversee and mentor junior and mid-level engineers.
• Delegate tasks with clear expectations.
• Own delivery of assigned workstreams with quality and timeliness.
• Build pipelines for processing large volumes of medical data.
• Participate in design, development, deployment and maintenance.
• Conduct peer code reviews.
• Define and adopt technical standards.
• Create comprehensive automated tests.

Skills

SQL

Python

Scala

Databricks

Azure Cloud Services

Big Data

ETL design

CI/CD (Jenkins/GitLab)

FastAPI

Agile/Scrum

Data profiling

Tools

Jenkins

GitLab

Delta lake

Parquet

FastAPI

Job description

Senior Big Data Engineer

Warsaw, Poland

Full time

R1566313

The Role

We are looking for an experienced, innovative and highly motivated engineer who is capable of working independently to design, develop, and support data engineering solutions. This role requires a considerable focus on understanding our data we deal with as an organization, develop a better understanding of our data through profiling, take ownership of the solution design, work collaboratively with the wider engineering team to implement optimal solutions in a timely manner and ensure successful deployment and operation of the platform in production. Our platform helps solve complex business challenges pertaining to healthcare data such as mapping wide variety of healthcare drug and diagnosis data to standard coding frames. You will have the opportunity to solve complex engineering challenges and develop innovative solutions. In your daily work you will be responsible for creation and delivery of a platform loading and processing millions of electronic medical records.

The Team

The Systems Engineering team is part of the Global Infrastructure & Operations (GIO) and remains one of the most dynamic and fast-growing groups in the organization. We are passionate about Agile software development and are among the strongest advocates for DevOps and Test-Driven Development (TDD). Our culture promotes autonomy and collaboration, empowering individuals to thrive within self-organizing teams. Our work involves processing and analyzing a wide range of patient-level healthcare data, which supports solving complex healthcare challenges - from retrospective clinical studies to disease progression modelling.

In your daily activities, you will collaborate with a team of Architects who design effective solutions, and with the Quality Assurance team, which ensures the highest standards of software quality.

The Data

We process over a billion records at a time; our engineers are responsible for the data analysis and construction and optimization of data flow processes. You will build data pipeline using ETL solutions for acquiring, processing and loading medical data into the Databricks.

Core Responsibilities

• Ability to oversee and guide junior and mid-level engineers, providing technical direction and mentoring to support their growth.

• Delegating tasks effectively, ensuring clarity of expectations and alignment with delivery goals.

• Ownership for the delivery of assigned workstreams, ensuring quality, timeliness, and accountability across the team.

• Build pipelines for processing big amount of medical data

• Participate in analysis, system design, development, deployment and maintenance

• Conduct peer code reviews

• Contribute to the definition and adoption of technical standards

• Create comprehensive automated unit and integration tests

Technical skills and knowledge

• 6 years of the following language: SQL, Python, Scala

• 6 years of experience in data engineering

• Strong understanding of Databricks platform

• Experience with Big Data Batch processing and Azure Cloud Services

• Practical knowledge of Apache Spark ecosystem, including Delta and Parquet data formats

• Experience with complex ETL design and implementation

• Experience with data analysis, data profiling, data integration, data quality, data warehousing, data reporting

• Experience with CI/CD automation processes and tools such as Jenkins/GitLab

• Familiarity with AI-powered productivity tools such as Copilot or Cursor, and their practical use in day-to-day software development workflows (e.g. code generation, documentation, task automation, or debugging support)

• Practical experience with FastAPI for building production-grade APIs is a plus

• Experience working in an Agile environment

• Experience with database design and modelling

• Previous experience with healthcare or pharmaceutical data would be an advantage

• Knowledge of algorithms & design patterns and how to apply them effectively

• Experience with large data volume (TBs') processing

• undefined

Personal skills and behaviors

• Excellent analytical & troubleshooting skills

• Strong collaboration, written, and verbal skills

• Familiarity with project management concepts, specifically Agile/Scrum

• Ability to present complex results in a clear language for both technical and non-

• technical audience

• Experience collaborating with teams from Europe, with an understanding of cross-cultural communication and remote delivery dynamics

A great team player mindset

What we offer

• Work in a company with offices in over 100 countries around the world, listed on the American stock exchange (NYSE)

• Multi-terabyte databases

• Quarterly work planning - goals and progress review every 90 days

• Technical training

• Possibility to participate in technical conferences within the country

• Favourable employment conditions and benefits

• undefined

IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create intelligent connections to accelerate the development and commercialization of innovative medical treatments to help improve patient outcomes and population health worldwide. Learn more at https://jobs.iqvia.com

IQVIA is committed to integrity in our hiring process and maintains a zero tolerance policy for candidate fraud. All information and credentials submitted in your application must be truthful and complete. Any false statements, misrepresentations, or material omissions during the recruitment process will result in immediate disqualification of your application, or termination of employment if discovered later, in accordance with applicable law. We appreciate your honesty and professionalism.

The potential base pay range for this role, when annualized, is zł188,700.00 - zł350,200.00. The actual base pay offered may vary based on a number of factors including job-related qualifications such as knowledge, skills, education, and experience; location; and/or schedule (full or part-time). Dependent on the position offered, incentive plans, bonuses, and/or other forms of compensation may be offered, in addition to a range of health and welfare and/or other benefits.

IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create connections that accelerate the development and commercialization of innovative medical treatments. Everything we do is part of a journey to improve patient outcomes and population health worldwide.

To get there, we seek out diverse talent with curious minds and a relentless commitment to innovation and impact. No matter your role, everyone at IQVIA contributes to our shared goal of helping customers improve the lives of patients everywhere. Thank you for your interest in growing your career with us.

EEO Minorities/Females/Protected Veterans/Disabled