Senior Data Platform Engineer Databricks Cloud ETL Master

Luxoft; United Kingdom; Remote; GBP 70,000 - 90,000; Full time

Job summary

A leading technology consulting firm is seeking a seasoned Platform Engineer with a strong background in data engineering. You will manage and optimize data platforms like Databricks and Palantir, ensuring high availability and performance. The ideal candidate has at least 10 years of IT experience and expertise in cloud infrastructure. Strong proficiency in Python and SQL is essential, along with familiarity with data warehousing concepts and ETL processes.

Qualifications

• Minimum 10 years of experience in IT/Data.
• Minimum 5 years of experience as a Data Platform Engineer/Data Engineer.
• Expertise in Azure, AWS for cloud infrastructure.

Responsibilities

• Manage and optimize data platforms (Databricks, Palantir).
• Ensure high availability, security, and performance of data systems.
• Optimize ETL processes for better performance and reliability.

Skills

Data Engineering

Platform Integration

Data Warehousing

ETL Optimization

SQL Query Optimization

Python Programming

Cloud Platforms

Version Control

Education

Bachelor's in IT or related field

Tools

PySpark

Databricks

Palantir

Docker

Kubernetes

Terraform

Job description

A leading technology consulting firm is seeking a seasoned Platform Engineer with a strong background in data engineering. You will manage and optimize data platforms like Databricks and Palantir, ensuring high availability and performance. The ideal candidate has at least 10 years of IT experience and expertise in cloud infrastructure. Strong proficiency in Python and SQL is essential, along with familiarity with data warehousing concepts and ETL processes.