Senior Big Data Engineer - Spark/Scala-Python, Flexible

Grid Dynamics; Fatih; Presencial; TRY 1.072.041 - 1.500.857; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Opportunity to work on bleeding-edge projects

Competitive salary

Flexible schedule

Professional development opportunities

Descripción de la vacante

A global technology company is seeking a Mid-Senior Level Engineer to develop a high-performance data analytics platform. Key responsibilities include creating scalable data ingestion jobs using Scala and Apache Spark, implementing robust ETL pipelines, and maintaining high data quality. Candidates must have strong experience with cloud storage solutions and distributed systems. The role offers competitive pay, professional growth opportunities, and the chance to work on cutting-edge projects in a collaborative environment.

Formación

• Expert-level proficiency with Apache Spark for batch and streaming.
• Hands-on experience with Apache Iceberg or similar formats.
• Strong engineering skills in Scala and/or Python.

Responsabilidades

• Develop and maintain scalable data ingestion and transformation jobs.
• Implement Spark-based ETL/ELT pipelines for data migration.
• Ensure data quality checks and validations throughout the lifecycle.

Conocimientos

Apache Spark

Scala

Python

Apache Iceberg

Kubernetes

Terraform

HDFS

Herramientas

Apache Flink

AWS S3

Descripción del empleo

A global technology company is seeking a Mid-Senior Level Engineer to develop a high-performance data analytics platform. Key responsibilities include creating scalable data ingestion jobs using Scala and Apache Spark, implementing robust ETL pipelines, and maintaining high data quality. Candidates must have strong experience with cloud storage solutions and distributed systems. The role offers competitive pay, professional growth opportunities, and the chance to work on cutting-edge projects in a collaborative environment.