Data Engineer

LA International; Greater London; Hybrid; GBP 135,000 - 177,000; Full time

Job summary

LA International is seeking a Data Engineer for a 12-month contract in London. The role involves hands-on Palantir Foundry work, building ontologies, pipelines, and scalable ETL solutions using Python and PySpark.

The position requires integration of data from multiple sources, optimization of Spark-based processing, and collaboration with business stakeholders to deliver analytics-ready data products. Hybrid onsite work in London is expected.

Qualifications

• Palantir Foundry expertise including ontology, pipelines, and modular apps.
• Strong Python and PySpark programming skills.
• Experience building ETL data integration solutions.
• Familiarity with SQL and data modeling concepts.
• Big data and distributed systems knowledge, Spark-based.

Responsibilities

• Build and maintain Palantir Foundry ontologies, pipelines, and applications.
• Design and develop scalable ETL/data engineering solutions using Python and PySpark.
• Integrate and transform data from multiple enterprise sources.
• Optimize Spark-based data processing and workflow performance.
• Collaborate with stakeholders to deliver analytics-ready data products.

Skills

Palantir Foundry

Python

PySpark

SQL

Pandas

NumPy

Spark

ETL

Data Modeling

Job description

Data Engineer

12 Month contract initially + Extensions

Based: 2-3 days p/w onsite in London

Rate: £Market rates p/d (Flexible) - (via Umbrella company)

Key Responsibilities

• Build and maintain Palantir Foundry ontologies, pipelines, and applications.
• Design and develop scalable ETL/data engineering solutions using Python and PySpark.
• Integrate and transform data from multiple enterprise data sources.
• Optimize Spark-based data processing and workflow performance.
• Collaborate with business stakeholders to deliver analytics and AI-ready data products.

Key Skills & Experience

• Palantir Platform Expertise
  • Working with Foundry Ontology, pipelines, and modular applications.
  • Implementing End to End data Solutions in Palantir sourcing data from
• Programming & Scripting (Python and PySpark)
  • Data Processing & Automation: Ability to clean, transform, and process large datasets efficiently.
  • Integration with Palantir Foundry: Build custom Python functions and libraries to extend Foundry's capabilities.
  • Pipeline Development: Write modular, reusable code for ETL workflows and data transformations.
  • Performance Optimization: Use Python libraries like Pandas, NumPy, and PySpark for scalable data operations.
  • Familiarity with SQL for querying and data modelling. Good to have
• Data Engineering Fundamentals
  • Building ETL pipelines for ingestion and transformation.
  • Designing data models and optimizing workflows.
  • Handling structured and unstructured data.
• Big Data & Distributed Systems
  • Experience with Spark (PySpark) for scalable data processing.
  • Understanding of parallel computing and performance tuning.

We welcome applications from all individuals, regardless of background or identity, and we encourage candidates who may not meet every listed requirement to still apply. If you require any adjustments or support during the recruitment process, please let us know and we will work with you to ensure a fair and accessible experience.