Senior Data Engineer (GenAI / LLM) AI, GenAI, LLM, SQL, Kafka Warsaw, Gdańsk, Gdynia

DCG Poland; Poland; Sur place; PLN 167 400 - 279 000; Plein temps

Avantages offerts par ce poste

Private medical care

Co-financing for sports card

Support of dedicated consultant

Résumé du poste

DCG Poland is looking for an experienced engineer to design and implement LLM-assisted workflows to enhance developer productivity and improve data pipeline delivery. The role involves building AI-driven automation, support of the message lifecycle, and ensuring quality through AI-supported testing.

Ideal candidates will have hands-on experience with LLM-powered automation, data engineering, and strong discipline around AI outputs. Offers include private medical care and sports card co-financing.

Qualifications

• Hands-on experience building LLM-powered automation for engineering workflows.
• Experience with AI-assisted test generation and test automation concepts.
• Strong engineering discipline around quality and safety for AI outputs.

Responsabilités

• Design and implement LLM-and agent-assisted workflows.
• Build and enhance AI-driven automation for engineering processes.
• Drive AI-powered test automation and quality validation.

Connaissances

LLM-powered automation

AI-assisted review/approval flows

Data engineering

Kafka

SQL transformations

CI/CD pipelines

Description du poste

Responsibilities

• Design and implement LLM‑and agent‑assisted workflows to improve developer productivity and reliability of data pipeline delivery
• Build and enhance AI‑driven automation for engineering processes, including: pull request automation, quality gates and assistive development tooling
• Implement AI‑supported schema review and governance gates within the canonical message lifecycle
• Drive AI‑powered test automation, including automated E2E test generation and quality validation
• Develop and maintain data packaging pipelines transforming source data into canonical message formats aligned with Data Packaging Framework and Availability Layer patterns
• Build and manage SQL‑based data transformations and configuration‑driven pipelines
• Support the canonical message lifecycle, including:schema validation, versioning, compatibility checks and publishing workflows
• Contribute to framework releases, operational stability, and documentation
• Maintain and update Architecture Decision Records (ADRs)

Requirements

• Hands‑on experience building LLM‑powered automation for engineering workflows (e.g., review gates, quality checks, assistant tooling for dev/test/docs)
• Experience with AI‑assisted review/approval flows and integrating AI steps into CI/CD‑style pipelines
• Experience with AI‑assisted test generation / test automation concepts
• Strong engineering discipline around quality and safety for AI outputs (evaluation mindset, reproducibility, traceability)
• Strong experience in data engineering and distributed processing; practical delivery mindset
• Hands‑on experience with Kafka and SQL‑based transformations
• Experience with batch/stream processing frameworks (e.g., Flink or Spark)
• Familiarity with schema formats and lifecycle (e.g., JSON/Avro/XSD) and versioning/compatibility concepts
• Experience working with Git workflows and Kubernetes environments
• CI/CD and build pipeline experience (Bazel + Tekton)

Nice to have

• Experience with Data Reference Architecture / data product model
• Knowledge of Airflow, Snowflake, Iceberg, or similar data platforms
• Exposure to data governance, metadata, and lineage concepts
• Experience in banking or other regulated environments

Offer

• Private medical care
• Co‑financing for the sports card
• Constant support of dedicated consultant