Senior Palantir Data Platform Engineer

Luxoft Poland; Poland; On-site; PLN 260,000 - 380,000; Full time

Benefits offered by this job

LuxMed private health and dental care

Life and travel insurance

MyBenefit program (sports card, well‑n

Employee Assistance Program for you &/

Car rental options

Job summary

Luxoft Poland is seeking a talented Palantir Data Platform Engineer with strong Python expertise to design, build, and optimize scalable data pipelines using Palantir Foundry and Databricks. The role requires hands-on experience with distributed data systems, cloud platforms such as Azure or AWS, and CI/CD practices.

Collaboration with data scientists, analysts, and architects will drive delivery across projects.

Qualifications

• 5+ years of experience in a Senior Data Engineer or Palantir Data Platform Engineer role.
• Hands-on Palantir Foundry experience: data pipelines, ontology, transformations, workflow orchestration.
• Big Data: Hadoop, Apache Spark, PySpark or equivalent distributed frameworks.
• Data Security and Governance: best practices for security, lineage, quality, and compliance.
• Python and PySpark for scalable data processing.
• Advanced SQL: writing and optimizing complex queries.
• ETL/ELT design and enterprise data workflows.
• Data pipelines: cleansing, profiling, lineage, scalable development.
• API integration with REST/SOAP and external systems.
• Python libraries: building reusable libraries.
• Git and collaborative development workflows.
• Cloud experience with Azure/AWS.
• CI/CD & DevOps: pipelines, automation, deployment best practices.
• Data Visualization: Power BI/Tableau experience.
• Collaboration tools: Azure DevOps, Jira, Confluence.
• Educational background in CS/Math/Engineering or related field.
• Familiarity with financial markets is a plus.

Responsibilities

• Participate in requirements clarification and sprint planning sessions.
• Design, develop, and maintain scalable data pipelines in Palantir Foundry.
• Build and optimize ingestion, transformation, and integration workflows using Python, SQL, and PySpark.
• Develop unit and integration tests for data pipelines and platform components.
• Support deployment, monitoring, and troubleshooting of data workflows across cloud and distributed environments.
• Collaborate with QA and stakeholders during testing and acceptance phases.
• Continuously improve best practices for data engineering, CI/CD, code quality, and platform performance.
• Work with cross-functional teams to ensure efficient delivery.
• Stay updated with Palantir Foundry and cloud technologies; contribute to docs and code reviews.

Skills

Palantir Foundry

Python

PySpark

SQL

APIs

CI/CD

Cloud platforms

Data Pipelines

Data Security

Data Governance

Git

Databricks

Hadoop

Education

Bachelor's or higher in CS/Math/Engineering

Tools

Databricks

Hadoop

Git

Azure DevOps

Jira

Confluence

REST/SOAP APIs

Job description

We are actively seeking a talented Palantir Data Platform Engineer with strong proficiency in Python programming, modern data engineering practices, and cloud-based platforms. The ideal candidate will have experience building scalable data pipelines, working with distributed data systems, and developing solutions using Palantir Foundry and Databricks. Experience with cloud platforms such as Azure or AWS, CI/CD processes, APIs, and data integration frameworks will be highly valued.

Participate in requirements clarification and sprint planning sessions.

Design, develop, and maintain scalable data pipelines and solutions within Palantir Foundry aligned with business and project goals.

Build and optimize data ingestion, transformation, and integration workflows using Python, SQL, and PySpark.

Develop unit and integration tests to ensure reliability and quality of data pipelines and platform components.

Support deployment, monitoring, and troubleshooting of data workflows across cloud and distributed environments.

Collaborate with QA engineers and stakeholders during testing and acceptance phases, resolving issues promptly.

Continuously improve best practices for data engineering, CI/CD, code quality, and platform performance.

Work closely with cross-functional teams including data scientists, analysts, architects, and developers to ensure efficient delivery.

Stay up to date with Palantir Foundry, cloud technologies, and modern data engineering best practices.

Contribute to technical documentation and actively participate in code reviews and knowledge sharing.

Mandatory Skills Description:

• 5+ years of relevant experience in a Senior Data Engineer or Palantir Data Platform Engineer role.
• Hands-on experience with Palantir Foundry, including data pipelines, ontology, transformations, and workflow orchestration.
• Big Data Technologies: Familiarity with Hadoop, Apache Spark, PySpark, or other distributed computing frameworks.
• Data Security and Governance: Strong understanding of data security, governance, data lineage, data quality, and compliance best practices.
• Python and PySpark: Strong expertise in Python and PySpark for scalable data processing and analytics.
• Advanced SQL Knowledge: Ability to write and optimize complex SQL queries and database operations.
• ETL Experience: Proven experience designing and supporting ETL/ELT processes and enterprise data workflows.
• Data Pipelines: Experience with data cleansing, profiling, lineage, and scalable pipeline development.
• API Integration: Experience integrating data pipelines with REST/SOAP APIs and external systems.
• Python Libraries: Familiarity with building reusable Python libraries and frameworks.
• Version Control: Proficiency with Git and collaborative development workflows.
• Cloud Technology Experience: Experience with Azure, AWS, or other leading cloud platforms.
• CI/CD & DevOps: Familiarity with CI/CD pipelines, automation, and deployment best practices.
• Data Visualization: Exposure to Power BI, Tableau, or similar reporting/visualization tools.
• Collaboration Tools: Experience with Azure DevOps, Jira, Confluence, or similar tools.
• Educational Background: Degree in Computer Science, Mathematics, Statistics, Engineering, or related technical discipline.
• Financial Markets Knowledge: Familiarity with financial markets, portfolio theory, and risk management is a plus.

Nice-to-Have Skills Description:

• Streaming Data Processing: Exposure to streaming data processing technologies like Apache Kafka for real-time data ingestion and processing.
• Containerization: Knowledge of containerization technologies like Docker for creating, deploying, and running applications consistently across various environments.
• Data Modeling and Evaluation: Extensive experience in data modeling and the evaluation of large datasets.
• Model Training, Deployment, and Maintenance: Background in training, deploying, and maintaining models for effective data-driven decision-making.
• Requirements for Machine Learning: Experience in developing and implementing machine learning algorithms, Natural Language Processing (NLP), and Neural Networks.
• Applied Mathematics: Proficiency in applied mathematics, including but not limited to linear algebra, probability, statistics, and distributions.

Our Benefits:

• Stable employment based on an employment contract
• Copyright-based remuneration for Developers, resulting in a higher net salary
• LuxMed private health and dental care
• Life and travel insurance
• MyBenefit program (sports card, well-being initiatives, and more)
• Employee Assistance Program for you and your family, including psychological consultations, coaching sessions, and support in personal matters
• Car rental options

Learning & Development

• Access to the LuxTalent platform, offering webinars, training sessions, and certified courses
• Internal Mobility Program, enabling rotation between projects, locations, and accounts