Senior GCP Data Engineer

emagine; Polska; Remote; PLN 180,000 - 240,000; Full time

Job summary

emagine is seeking a Senior GCP Data Engineer to design scalable data platforms for the telecommunications sector. You will build batch and real-time pipelines, and contribute to a critical project at the start of the team’s development.

You’ll work with Kafka, Flink, Python, Spark, PySpark, SQL, Hadoop and Snowflake, and communicate in English. This remote, 12-month assignment is on a B2B basis, with emphasis on streaming architectures and data lakes.

Qualifications

• Strong GCP Data Engineering experience.
• Hands-on coding skills.
• Proven streaming experience.
• Experience with Apache Kafka and Apache Flink.
• Proficiency in Python, Spark, PySpark and SQL.
• Experience with Hadoop and Snowflake, including data lakes and ETL/ELT pipelines.
• Fluent in English.

Responsibilities

• Design and build scalable batch and real-time data platforms.
• Develop high-throughput, event-driven streaming pipelines processing large volumes of events per second.
• Implement end-to-end streaming architectures.
• Work with temporal joins, watermarks, state management, checkpointing, and exactly-once processing.
• Monitor backpressure and optimize pipeline performance.
• Design and develop data lakes, ETL/ELT pipelines and analytics-ready data platforms.
• Write production-ready code and successfully complete live coding assessments.

Skills

GCP Data Engineering

Streaming

Python

Spark

PySpark

SQL

English

Tools

Apache Kafka

Apache Flink

Hadoop

Snowflake

Job description

Details

Industry: Telecommunications

Work model: Remote

Team Size: Approximately 10 people

Assignment type: B2B

Project Duration: 12 months, starting ASAP

The role of the Senior GCP Data Engineer revolves around building scalable data platforms for the telecommunications industry, contributing to a critical project at the onset of team development.

Responsibilities

• Design and build scalable batch and real-time data platforms.
• Develop high-throughput, event-driven streaming pipelines processing large volumes of events per second.
• Implement end-to-end streaming architectures.
• Work with temporal joins, watermarks, state management, checkpointing, and exactly-once processing.
• Monitor backpressure and optimize pipeline performance.
• Design and develop data lakes, ETL/ELT pipelines and analytics-ready data platforms.
• Write production-ready code and successfully complete live coding assessments.

Must Haves

• Strong Google Cloud Platform (GCP) Data Engineering experience.
• Strong hands-on coding skills.
• Proven streaming experience.
• Experience with Apache Kafka and Apache Flink.
• Proficiency in Python, Spark, PySpark, and SQL.
• Experience with Hadoop and Snowflake, including data lakes and ETL/ELT pipelines.
• Fluent in English.

Nice to Haves

• Experience with Agile methodologies.
• Keen problem-solving abilities.
• Familiarity with telecom industry standards.