Lead Data Engineer

Klarna; Bardi; In loco; EUR 65.000 - 90.000; Tempo pieno

Descrizione del lavoro

Klarna is seeking a Lead Data Engineer to build and operate analytical data platforms on AWS for large-scale batch and analytical workloads. You will shape data pipelines, table structures, and access patterns to support analytics, model training, and downstream consumption.

You will lead cross-team data initiatives, design robust architectures for scale, and uphold high standards for code quality, security, and reliability on our data platform stack including Glue, Spark, S3, Iceberg,

Competenze

• Extensive experience building analytical data platforms on AWS with Spark processing and S3-backed data lakes.
• Strong Python skills and experience with IaC (Terraform).
• Ability to lead cross-team data initiatives and set production-grade standards.
• Experience designing data pipelines, table structures, and access patterns.

Mansioni

• Build and operate analytical data platforms on AWS for batch and analytics workloads.
• Design data pipelines, tables, and access patterns for analytics and model training.
• Evolve platform architecture for scale, cost efficiency, security, and reliability.
• Lead data processing system design using Spark, AWS Glue, S3, Iceberg, Databricks, Redshift.
• Set high standards for code quality, maintainability, and production readiness.
• Collaborate across teams to drive architectural decisions and delivery.

Conoscenze

Python

Spark

AWS

Terraform

IAM

Data modeling

Cross-team collaboration

Strumenti

AWS Glue

Databricks

Iceberg

Redshift

Descrizione del lavoro

In this role you will build and operate Klarna’s analytical data processing platforms on AWS, enabling large-scale batch and analytical workloads. You will shape data pipelines, table structures, and access patterns to support analytics, model training, and downstream consumption. You’ll evolve platform architecture for scale, cost efficiency, security, and reliability, while leading cross-team data initiatives and upholding high code quality and operational excellence.

• Build and operate analytical data processing platforms on AWS to support batch and analytical workloads
• Design robust data pipelines, table structures, and access patterns for analytics, model training, and downstream consumption
• Evolve platform architecture and AWS foundations for scale, cost efficiency, security, and reliability
• Lead core data processing system design using AWS Glue, Spark, S3, Iceberg, Databricks, and Redshift
• Set high standards for code quality, maintainability, and production readiness
• Drive architectural decisions with awareness of the broader data landscape and cross-team dependencies
• Design and evolve IAM models, roles, and access patterns for secure, scalable data platform use
• Identify and resolve complex performance, scalability, cost, security, and compliance challenges
• Act as a technical leader in cross-team initiatives, delivering production-ready solutions
• Extensive experience building analytical data platforms on AWS with Spark processing and S3-backed data lakes
• Strong Python skills, distributed data processing, and infrastructure-as-code (Terraform) experience
• Experience with modern table formats (Iceberg) and data warehouses (Redshift)
• Experience designing and operating IAM and AWS account setups for data platforms
• Product-oriented mindset focused on durable, scalable solutions rather than one-off pipelines
• Experience operating systems in production with monitoring, incident handling, and iteration
• Cross-functional collaboration
• Technical leadership
• Problem-solving orientation
• Python
• Spark
• AWS Glue

Lead Data Engineer • pavia, lombardia, it