Senior Data Platform Architect

Luxoft; Schweiz; Remote; CHF 120’000 - 160’000; Vollzeit

Zusammenfassung

A technology solutions provider is seeking an experienced Platform Engineer in Switzerland with expertise in data engineering. The role involves managing and optimizing data platforms, ensuring system performance, and providing insights on data utilization. Candidates should have at least 10 years of IT experience and extensive knowledge in various data platform tools and programming skills.

Qualifikationen

• Minimum 10 Years of experience in IT/Data.
• Minimum 5 years of experience as a Data Platform Engineer/Data Engineer.
• Experience writing and optimizing SQL queries, preferably with PostgreSQL, MySQL, Oracle, or Snowflake.

Aufgaben

• Manage and optimize data platforms (Databricks, Palantir).
• Ensure high availability, security, and performance of data systems.
• Provide valuable insights about data platform usage.

Kenntnisse

Proficiency in PySpark for distributed computing

Expertise in SQL query optimization

Experience with Azure

Experience with AWS

Proficiency in Python for ETL development

Experience with data warehousing concepts

Familiarity with ETL tools and processes

Ausbildung

Bachelor's in IT or related field

Tools

Databricks

Palantir

Snowflake

Docker

Kubernetes

Terraform

Jobbeschreibung

Overview

We are seeking an expert with deep proficiency as a Platform Engineer, possessing experience in data engineering. This individual should have a comprehensive understanding of both data platforms and software engineering, enabling them to integrate the platform effectively within an IT ecosystem.

Responsibilities

• Manage and optimize data platforms (Databricks, Palantir).
• Ensure high availability, security, and performance of data systems.
• Provide valuable insights about data platform usage.
• Optimize computing and storage for large-scale data processing.
• Design and maintain system libraries (Python) used in ETL pipelines and platform governance.
• Optimize ETL Processes – Enhance and tune existing ETL processes for better performance, scalability, and reliability.

Skills

Must have

• Minimum 10 Years of experience in IT/Data.
• Minimum 5 years of experience as a Data Platform Engineer/Data Engineer.
• Bachelor's in IT or related field.
• Infrastructure & Cloud: Azure, AWS (expertise in storage, networking, compute).
• Data Platform Tools: Any of Palantir, Databricks, Snowflake.
• Programming: Proficiency in PySpark for distributed computing and Python for ETL development.
• SQL: Expertise in writing and optimizing SQL queries, preferably with experience in databases such as PostgreSQL, MySQL, Oracle, or Snowflake.
• Data Warehousing: Experience working with data warehousing concepts and platforms, ideally Databricks.
• ETL Tools: Familiarity with ETL tools & processes
• Data Modelling: Experience with dimensional modelling, normalization/denormalization, and schema design.
• Version Control: Proficiency with version control tools like Git to manage codebases and collaborate on development.
• Data Pipeline Monitoring: Familiarity with monitoring tools (e.g., Prometheus, Grafana, or custom monitoring scripts) to track pipeline performance.
• Data Quality Tools: Experience implementing data validation, cleaning, and quality frameworks, ideally Monte Carlo.

Nice to have

• Containerization & Orchestration: Docker, Kubernetes.
• Infrastructure as Code (IaC): Terraform.
• Understanding of Investment Data domain (desired).