Senior Data Engineer, Madrid

EPAM; Madrid; Presencial; EUR 45.000 - 70.000; Jornada completa

Descripción de la vacante

A leading technology company, EPAM, is seeking a Senior Data Engineer to enhance their team in Madrid. The ideal candidate will have over 4 years of experience in software engineering, particularly with Palantir Foundry, and possess strong skills in Python and PySpark. This role focuses on data ingestion and large pipeline management, offering opportunities for professional growth in a dynamic environment.

Servicios

Private health insurance

EPAM Employees Stock Purchase Plan

100% paid sick leave

Referral Program

Professional certification opportunities

Language courses

Formación

• 4+ years of experience in front-end software engineering.
• Hands-on experience with Palantir Foundry for back-end pipeline development.
• Familiarity with Python, PySpark, and Spark.

Responsabilidades

• Ingest data from various sources into the Palantir Foundry platform.
• Design and maintain large Big Data pipelines using PySpark.
• Develop front-end applications for data consumption.

Conocimientos

Palantir Foundry

Python

PySpark

JavaScript

TypeScript

GenAI

Descripción del empleo

Senior Data Engineer

Do you have a software engineering background and strong knowledge of Palantir Foundry? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Senior Data Engineer.

EPAM is shaping the digital future for Fortune 1000 companies, building complex solutions using modern technologies. We are looking for a Senior Data Engineer with Palantir experience and an open-minded personality who can join our friendly environment and become a core contributor to our team of experts.

Responsibilities

• Data ingestion of many sources from different domains into Palantir Foundry platform
• Design and maintain very large Big Data pipelines (PySpark) consisting of more than 350 datasets, including orchestration and monitoring
• Entity resolution (fuzzy matching) of sites (health care centres) and investigators from various sources
• Data Science: segmentation and targeting of sites and investigators to help users identify the best potential candidates across different features
• Development of front-end applications to facilitate data consumption by end-users, using Workshop and coding in TypeScript

Requirements

• 4+ years of experience in front-end software engineering
• Hands-on experience with Palantir Foundry, including code workspace, pipeline builder, and ontology for back-end pipeline development using Python, PySpark, and Spark
• Experience with GenAI
• Proficiency in JavaScript, Workshop, Slate

Nice to Have

• Ontology expertise

We Offer

• Private health insurance
• EPAM Employees Stock Purchase Plan
• 100 paid sick leave
• Referral Program
• Professional certification opportunities
• Language courses