Data Engineer II: Real-Time Security Pipelines (Remote)

Akamai Career Site; Polska; À distance; PLN 180 000 - 260 000; Plein temps

Résumé du poste

Akamai in Krakow is seeking a Data Engineer in Test to design scalable data pipelines for security analytics and threat protection. You will work with Spark, Kafka, Delta Lake, Python/Scala/Java, and orchestration with Airflow or Argo, contributing to real-time data platforms.

Join a fast-moving team to build production-grade pipelines, with on-call rotations and collaboration with Data Science, SecOps, and Analytics teams.

Qualifications

• Hands-on experience building production data pipelines at scale.
• Advanced proficiency in Apache Spark for large-scale processing (batch and/or streaming).
• Strong SQL and NoSQL database experience.
• Experience with streaming technologies (Kafka, RabbitMQ, or SQS).
• Experience with Python, Scala, or Java.
• Data modeling, schema design, and ETL/ELT patterns.
• Hands-on orchestration tools (Airflow, Argo Workflows).
• Containerization with Docker and Kubernetes.

Responsabilités

• Designing and build scalable data pipelines processing internet-scale volumes of security data
• Developing and maintain batch and real-time ETL/ELT workflows using Spark, Kafka, and Delta Lake
• Owning the full lifecycle of data systems: build, deploy, monitor, and optimize production pipelines
• Writing production-grade, tested code with a focus on data quality, reliability, and performance
• Collaborating with Data Science, SecOps, and Analytics teams to translate requirements into scalable data infrastructure
• Optimizing large-scale Spark jobs and implementing Argo-based data orchestration workflows
• Participating in on-call rotation to ensure system reliability

Connaissances

Apache Spark

SQL

NoSQL

Kafka

Argo Workflows

Airflow

Docker

Kubernetes

Python

Java

Scala

Data Modeling

ETL/ELT

Outils

Airflow

Argo Workflows

Docker

Kubernetes

Description du poste

Akamai in Krakow is seeking a Data Engineer in Test to design scalable data pipelines for security analytics and threat protection. You will work with Spark, Kafka, Delta Lake, Python/Scala/Java, and orchestration with Airflow or Argo, contributing to real-time data platforms.

Join a fast-moving team to build production-grade pipelines, with on-call rotations and collaboration with Data Science, SecOps, and Analytics teams.