Senior Data Engineer (Apache Kafka)

SoftServe Inc.

Polska

Presencial

PLN 180.000 - 260.000

Jornada completa

Hace 7 días
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

SoftServe is seeking a Senior Data Engineer to join a next-generation data platform supporting energy-sector products. You will design canonical and semantic data models, integrate fragmented sources, and build real-time pipelines, owning the Apache Kafka platform.

The role focuses on creating reliable data foundations for cross-product reporting, analytics, AI/ML, and data observability, collaborating with product managers, data scientists, and engineers. Remote options are not specified.

Formación

  • 5+ years of professional data engineering experience.
  • Expert-level hands-on Apache Kafka experience, including production cluster setup and administration.
  • Strong SQL and Python skills for production data engineering.
  • Deep expertise in canonical and semantic data modeling.
  • Experience integrating data across heterogeneous systems with different schemas and contexts.
  • Experience with data observability, lineage, telemetry, and data quality monitoring is preferred.
  • Familiarity with Databricks, Snowflake, or similar platforms is an advantage.

Responsabilidades

  • Design and maintain canonical and semantic data models across multiple products and data domains
  • Define data contracts, standards, and integration patterns for heterogeneous systems
  • Build and maintain batch and real-time data pipelines
  • Architect, deploy, and administer Apache Kafka clusters
  • Own Kafka topic and partition design, replication, security, monitoring, capacity planning, and performance tuning
  • Create data foundations for reporting, analytics, machine learning, and LLM-based capabilities
  • Implement data lineage, usage tracking, telemetry, observability, and data quality monitoring
  • Collaborate with product managers, data scientists, and application engineering teams
  • Define and maintain data dictionaries, integration specifications, and architecture documentation
  • Drive cross-product data integration in complex and evolving environments

Conocimientos

SQL
Python
Apache Kafka
Data modeling
Data integration
Data observability

Herramientas

Schema Registry
Databricks
Snowflake
SageMaker

Descripción del empleo

About The Role

In this role, you will work as a Senior Data Engineer on a next-generation data platform supporting a broad portfolio of energy-sector products.

You will design canonical and semantic data models, integrate fragmented data sources, build real-time pipelines, and take ownership of the Apache Kafka platform. The role is focused on creating reliable, reusable data foundations for cross-product reporting, analytics, AI/ML, and data observability.

Responsibilities
  • Design and maintain canonical and semantic data models across multiple products and data domains
  • Define data contracts, standards, and integration patterns for heterogeneous systems
  • Build and maintain batch and real-time data pipelines
  • Architect, deploy, and administer Apache Kafka clusters
  • Own Kafka topic and partition design, replication, security, monitoring, capacity planning, and performance tuning
  • Create data foundations for reporting, analytics, machine learning, and LLM-based capabilities
  • Implement data lineage, usage tracking, telemetry, observability, and data quality monitoring
  • Collaborate with product managers, data scientists, and application engineering teams
  • Define and maintain data dictionaries, integration specifications, and architecture documentation
  • Drive cross-product data integration in complex and evolving environments
Requirements
  • 5+ years of professional data engineering experience
  • Expert-level hands-on Apache Kafka experience, including production cluster setup and administration
  • Strong experience with Kafka broker configuration, topics, partitions, replication, SASL/SSL, ACLs, schema registry, monitoring, alerting, and performance tuning
  • Deep expertise in canonical and semantic data modelling
  • Strong experience integrating data across heterogeneous systems with different schemas, frequencies, and business contexts
  • Strong SQL and Python skills for production data engineering
  • Experience designing data platforms for reporting, analytics, AI, and machine learning use cases
  • Strong understanding of data contracts, integration standards, and reusable data architectures
  • Excellent technical documentation and written communication skills
  • Ability to work autonomously and drive solutions in ambiguous environments
  • Experience with data observability, lineage, telemetry, and data quality monitoring is strongly preferred
  • Experience with Databricks, Microsoft Fabric, Snowflake, SageMaker, or similar platforms is an advantage
  • Experience supporting AI/ML pipelines, feature stores, training datasets, or embedding-ready data structures is an advantage
  • Knowledge of Kimball, Data Vault, and medallion architecture approaches is preferred
  • Experience with energy, Oil & Gas, or industrial operational data is a strong advantage

SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Data Engineer - Real-Time Kafka & Data Platform
Senior Data Engineer - Real-Time Kafka & Data Platform

SoftServe Inc. • Polska

Presencial
PLN 180.000 - 260.000
Data Engineer
Data Engineer

Collinson (Singapore) • Polonia

Presencial
PLN 180.000 - 240.000
Data Engineer with Kafka
Data Engineer with Kafka

Link Group • Wrocław, Poznań, Kraków

A distancia
PLN 180.000 - 280.000
100% remote work
B2B cooperation model
Opportunity to work with modern cloud‑
Senior Data Engineer (Java/Scala/Python, Spark, AWS)
Senior Data Engineer (Java/Scala/Python, Spark, AWS)

EPAM Systems • Polska

Presencial
PLN 180.000 - 300.000
Data Engineer
Data Engineer

Collinson Group • Polonia

Presencial
PLN 180.000 - 240.000
Data Engineer
Data Engineer

Sigma Software • Województwo mazowieckie

Presencial
PLN 180.000 - 260.000
Strong Middle Data Engineer
Strong Middle Data Engineer

Sigma Software • Województwo mazowieckie

Presencial
PLN 180.000 - 240.000
Senior Java Software Engineer
Senior Java Software Engineer

RE Partners • Polonia

Presencial
PLN 169.204 - 253.807
Senior Data Engineer
Senior Data Engineer

Backbase • Kraków

Presencial
PLN 180.000 - 240.000
Lead Data Engineer
Lead Data Engineer

SNI • Województwo mazowieckie

Presencial
PLN 120.000 - 180.000
Ubicaciones