Senior Data Platform Architect

Luxoft; Torino; In loco; EUR 50.000 - 80.000; Tempo pieno

Descrizione del lavoro

A leading IT consultancy in Torino is seeking a mid-senior level Platform Engineer with deep proficiency in data engineering. The role involves managing data platforms, ensuring security and performance, and optimizing ETL processes. Candidates should have at least 10 years of experience in IT, including 5 years as a Data Platform Engineer. A comprehensive understanding of data platforms, programming in PySpark, and SQL expertise are essential. The position offers a dynamic company culture and opportunities for training and knowledge sharing.

Servizi

Great company culture

Training programs

Employee discounts

Competenze

• Minimum 10 years of experience in IT/Data.
• Minimum 5 years of experience as a Data Platform Engineer/Data Engineer.
• Bachelor's in IT or related field.
• Proficiency in PySpark for distributed computing and Python for ETL development.
• Expertise in writing and optimizing SQL queries.

Mansioni

• Manage and optimize data platforms.
• Ensure high availability, security, and performance of data systems.
• Optimize computing and storage for large-scale data processing.
• Design and maintain system libraries used in ETL pipelines.
• Enhance and tune existing ETL processes.

Descrizione del lavoro

Overview

We are seeking an expert with deep proficiency as a Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem.

Responsibilities

• Manage and optimize data platforms (Databricks, Palantir).
• Ensure high availability, security, and performance of data systems.
• Optimize computing and storage for large-scale data processing.
• Design and maintain system libraries (Python) used in ETL pipelines and platform governance.
• Optimize ETL processes – enhance and tune existing ETL processes for better performance, scalability, and reliability.

Skills

Must have

• Minimum 10 Years of experience in IT/Data.
• Minimum 5 years of experience as a Data Platform Engineer/Data Engineer.
• Bachelor's in IT or related field.
• Data Platform Tools: Any of Palantir, Databricks, Snowflake.
• Programming: Proficiency in PySpark for distributed computing and Python for ETL development.
• SQL: Expertise in writing and optimizing SQL queries, preferably with experience in databases such as PostgreSQL, MySQL, Oracle, or Snowflake.
• Data Warehousing: Experience working with data warehousing concepts and platforms, ideally Databricks.
• ETL Tools: Familiarity with ETL tools & processes
• Data Modelling: Experience with dimensional modelling, normalization/denormalization, and schema design.
• Version Control: Proficiency with version control tools like Git to manage codebases and collaborate on development.
• Data Pipeline Monitoring: Familiarity with monitoring tools (e.g., Prometheus, Grafana, or custom monitoring scripts) to track pipeline performance.
• Data Quality Tools: Experience implementing data validation, cleaning, and quality frameworks, ideally Monte Carlo.

Nice to have

• Infrastructure as Code (IaC): Terraform.
• Understanding of Investment Data domain (desired).

Benefits

Great company culture and friendly environment; work within a fast-moving, exciting, and challenging environment. Luxoft Training Center services with ad-hoc leadership and technical programs. Meetings for knowledge sharing, celebrations, and brainstorming: your ideas count! Variety of discounts for our employees.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Engineering and Information Technology

Industries

• IT Services and IT Consulting

We’re not showing any unrelated prompts or notices beyond the job details here.