Data engineer for large language models

IQVIA; Warszawa; On-site; PLN 142,000 - 264,000; Full time

Job summary

IQVIA в Варшаве ищет инженера по данным, который будет строить и эксплуатировать масштабируемые конвейеры данных, обеспечивая воспроизводимость и управление версиями для обучения и оценки моделей LLM.

Вы будете работать с Snowflake, AWS и интеграциями платформ, сотрудничать с командами ML и инфраструктуры, чтобы ускорить исследования и внедрение моделей в реальных кейсах здравоохранения.

Qualifications

• Опыт в обработке больших данных и распределённых систем.
• Опыт работы с Snowflake/Snowpark и AWS data services.
• Опыт поддержки ML/AI рабочих нагрузок, включая конвейеры данных.

Responsibilities

• Поддержка и развитие конвейеров данных для инициатив LLM.
• Проектирование и эволюция трансформаций данных в Snowflake и AWS.
• Обеспечение доступности, производительности и контроля версий данных.
• Согласование данных и сроков с заинтересованными сторонами.

Skills

Big data engineering

Distributed data processing

Data lineage

ML/AI workflows

Model training pipelines

Collaboration with ML/infra teams

Data availability and performance

Tools

Snowflake

Snowpark

AWS

ETL pipelines

Job description

Описание

The Data Engineer will play a critical role in enabling the data, compute, and engineering foundations of our LLM platforms. The role focuses on building and operating scalable data pipelines, data lineage, and platform integrations required to support large-scale model training, evaluation, and experimentation across IQVIA market use cases.

Задачи

Support data engineering activities for LLM initiatives, including onboarding and transformation of large-scale healthcare datasets for model training and evaluation. Design, evaluate, and evolve data transformation pipelines across Snowflake and AWS-based environments, including performance evaluation of existing research workflows for production scale up. Enable data availability and migration to high-performance compute environments, ensuring data is accessible, performant, and version-controlled for modelling teams. Implement data lineage, versioning, and dataset reference management to ensure reproducibility and traceability across training and evaluation pipelines. Collaborate with modelling, MLOps, and infrastructure teams to support model lifecycle workflows, including integration with evaluation pipelines and model registries. Coordinate with stakeholders to define data requirements and timelines.

Требования

Strong experience in big data engineering and distributed data processing.

Hands‑on expertise with Snowflake/Snowpark, AWS data services, and large-scale datasets.

Experience supporting ML/AI workloads, including training and evaluation data pipelines.

Условия

Those who join us become part of a recognized global leader still willing to challenge the status quo to improve patient care. You will have access to the most cutting-edge technology, the largest data sets, the best analytics tools and, in our opinion, some of the finest minds in the Healthcare industry. You can drive your career at IQVIA and choose the path that best defines your development and success. With exposure across diverse geographies, capabilities, and vast therapeutic and information and technology areas, you can seek opportunities to change and grow without boundaries. Regardless of your role, we invite you to reimagine healthcare with us. You will have the opportunity to play an important part in helping our clients drive healthcare forward and ultimately improve human health outcomes. It's an exciting time to join and reimagine what's possible in healthcare. The potential base pay range for this role, when annualized, is zł142,100.00 - zł263,800.00. The actual base pay offered may vary based on a number of factors including job-related qualifications such as knowledge, skills, education, and experience; location; and/or schedule (full or part-time). Dependent on the position offered, incentive plans, bonuses, and/or other forms of compensation may be offered, in addition to a range of health and welfare and/or other benefits.