Senior Data Architect

Luxoft; Savona; Ibrido; EUR 60.000 - 90.000; Tempo pieno

Descrizione del lavoro

A leading technology consulting firm is seeking an expert Platform Engineer with extensive experience in data engineering. You will manage and optimize data platforms like Databricks and Palantir, ensuring their performance and security within an exciting and dynamic environment. The ideal candidate should have expertise in cloud technologies and a solid understanding of data warehousing. Join us for a flexible work schedule and numerous benefits that support talent development.

Servizi

Flexible work schedule

Great company culture

Talent development ecosystem

Training programs

Regular team-building activities

Employee discounts

Competenze

• Deep proficiency in Platform Engineering and data engineering.
• Experience in optimizing data platforms (Databricks, Palantir).
• Proven experience with cloud infrastructures (Azure, AWS).

Mansioni

• Manage and optimize data platforms.
• Ensure high availability, security, and performance.
• Provide insights on data platform usage.

Conoscenze

10 Years of experience in IT / Data

5 years of experience as a Data Platform Engineer / Data Engineer

Bachelor's in IT or related field

Azure, AWS expertise

Data platform tools like Databricks, Palantir

Proficiency in PySpark and Python

SQL expertise with PostgreSQL, MySQL

Data warehousing concepts

Familiarity with ETL tools

Dimensional modeling and schema design

Version control with Git

Monitoring tools experience

Data quality tools experience

Formazione

Bachelor's in IT or related field

Strumenti

Databricks

Palantir

Snowflake

Docker

Kubernetes

Terraform

Descrizione del lavoro

Project description

We are seeking an expert with deep proficiency as a Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem.

Responsibilities

Manage and optimize data platforms (Databricks, Palantir).

Ensure high availability, security, and performance of data systems.

Provide valuable insights about data platform usage.

Optimize computing and storage for large-scale data processing.

Design and maintain system libraries (Python) used in ETL pipelines and platform governance.

Optimize ETL Processes – Enhance and tune existing ETL processes for better performance, scalability, and reliability.

Skills

Must have

• Minimum 10 Years of experience in IT / Data.
• Minimum 5 years of experience as a Data Platform Engineer / Data Engineer.
• Bachelor's in IT or related field.
• Infrastructure & Cloud : Azure, AWS (expertise in storage, networking, compute).
• Data Platform Tools : Any of Palantir, Databricks, Snowflake.
• Programming : Proficiency in PySpark for distributed computing and Python for ETL development.
• SQL : Expertise in writing and optimizing SQL queries, preferably with experience in databases such as PostgreSQL, MySQL, Oracle, or Snowflake.
• Data Warehousing : Experience working with data warehousing concepts and platforms, ideally Databricks.
• ETL Tools : Familiarity with ETL tools & processes
• Data Modelling : Experience with dimensional modelling, normalization / denormalization, and schema design.
• Version Control : Proficiency with version control tools like Git to manage codebases and collaborate on development.
• Data Pipeline Monitoring : Familiarity with monitoring tools (e.g., Prometheus, Grafana, or custom monitoring scripts) to track pipeline performance.
• Data Quality Tools : Experience implementing data validation, cleaning, and quality frameworks, ideally Monte Carlo.

Nice to have

Containerization & Orchestration : Docker, Kubernetes.

Infrastructure as Code (IaC) : Terraform.

Understanding of Investment Data domain (desired).

Benefits

We offer numerous benefits such as :

Flexible work schedule

Great company culture and friendly environment

Work within a fast-moving, exciting, and challenging environment

Talent development ecosystem

Luxoft Training Center services with ad-hoc leadership and technical programs

Knowledge sharing in professional communities

Meetings for knowledge sharing, celebrations, and brainstorming : your ideas count!

Regular team-building activities

Variety of discounts for our employees