Senior Data Engineer (Kafka & Snowflake)

Grid Dynamics; Województwo pomorskie; On-site; PLN 180,000 - 280,000; Full time

Benefits offered by this job

Bleeding-edge projects

Competitive salary

Flexible schedule

Benefits package - medical insurance,

Professional development opportunities

Well-equipped office

Job summary

Grid Dynamics is building a brand-new regulatory reporting team for a global payments technology company. We are seeking a Senior Data Engineer to design streaming pipelines on Kafka and model regulatory reporting data in Snowflake, ensuring accuracy, auditable trails and reconciliation from day one.

You will shape the architecture, implement resilient data flows, and collaborate with client teams to set up processes and governance for streaming data, validation, and performance monitoring.

Qualifications

• Experience building production streaming and data pipelines.
• Strong knowledge of Kafka architecture including topics, partitions, consumer groups, offsets.
• Advanced SQL in Snowflake with window functions, complex joins and optimisations.
• Experience with Snowflake features: Streams & Tasks, Snowpipe, Time Travel.
• Ability to model data for regulatory reporting (facts, dimensions, SCD) and ensure reconciliation.

Responsibilities

• Design and build Kafka-based streaming pipelines with Kafka Streams and/or Kafka Connect.
• Implement robust error handling, retries, dead-letter queues, and schema evolution management.

Skills

Streaming pipelines

Kafka

SQL

Data modelling

English communication

Tools

Kafka Streams

Kafka Connect

Schema Registry

Snowpipe

Snowflake

Time Travel

Job description

We are seeking a Senior Data Engineer (Kafka & Snowflake) to join a brand-new regulatory reporting team being built from scratch for a global payments technology company. In this role, you will work alongside a small group of engineers and the client’s team to build reliable streaming pipelines on Kafka and reporting models in Snowflake, ensure the data behind regulatory reports is accurate, auditable and reconciled, and help define how the team works and how its architecture takes shape from day one.

Responsibilities

• Streaming Pipelines: Design and build Kafka-based data flows with Kafka Streams and/or Kafka Connect, choosing the right delivery guarantees, from at-least-once to exactly-once with idempotent producers and transactions.
• Resilient Event Processing: Implement error handling with retries, dead-letter queues and reprocessing, preserve message ordering, and manage schema evolution through Schema Registry with Avro or Protobuf.
• Reporting Data in Snowflake: Model facts, dimensions and SCD for regulatory reporting, and build ingestion and processing with Streams & Tasks, Snowpipe and Time Travel.
• Data Accuracy & Reconciliation: Implement reconciliation, validation and deduplication so that every reported figure can be trusted and traced.
• Performance & Monitoring: Monitor and tune consumer lag and throughput, and optimise Snowflake queries through execution plans, clustering keys, pruning and warehouse sizing.
• Shaping a New Team: Help define processes and architecture from scratch in a newly formed team.

Requirements

• Commercial experience as a data or software engineer building production streaming and data pipelines.
• Kafka Expertise: Strong knowledge of Kafka architecture (topics, partitions, consumer groups, offsets, replication), delivery guarantees, Kafka Streams and/or Kafka Connect, and Schema Registry with Avro or Protobuf.
• Advanced SQL in Snowflake: Complex queries with window functions, CTEs, aggregations and large-volume joins, plus hands-on query optimisation.
• Snowflake Platform: Practical experience with Streams & Tasks, Snowpipe and Time Travel.
• Reporting Data Modelling & Quality: Experience modelling data for reporting (facts, dimensions, SCD) and implementing reconciliation, validation and deduplication.
• Ownership & Communication: Independent and proactive, comfortable in a newly formed team, with good communication in English.

Nice to have

• Apache Flink: Experience with the DataStream API or Flink SQL, stateful processing, checkpointing, event time, watermarks and windowing.
• Java Ecosystem: Java 11/17+, Spring Boot and Spring Kafka, with testing in JUnit, Mockito and Testcontainers.
• Platform & Delivery: Kubernetes (deployments, Helm, scaling), CI/CD, Git and cloud experience.
• Regulatory & Financial Reporting: Experience in banking or payments reporting and a solid understanding of data auditability, lineage and accuracy requirements.

We offer

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package - medical insurance, sports
• Corporate social events
• Professional development opportunities
• Well-equipped office

About Us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.