Senior Data Engineer (GenAI / LLM) AI, GenAI, LLM, SQL, Kafka Warsaw, Gdańsk, Gdynia

Diverse CG Sp. z o.o. Sp.k.; Warszawa; On-site; PLN 60,000 - 90,000; Full time

Benefits offered by this job

Private medical care

Co-financing for the sports card

Constant support of dedicated consultant

Job summary

Diverse CG Sp. z o.o. Sp.k. in Warsaw is hiring for a role focused on designing LLM-and agent-assisted workflows that enhance developer productivity. Ideal candidates will have strong experience in building AI-driven automation and data engineering.

The position emphasizes quality and safety in AI outputs, and offers perks including private medical care and co-financing for a sports card. Join a dynamic team dedicated to innovation and operational excellence.

Qualifications

• Hands-on experience in building LLM-powered automation for engineering workflows.
• Strong engineering discipline around quality and safety for AI outputs.
• Experience with batch and stream processing frameworks.

Responsibilities

• Design and implement AI-driven workflows to improve developer productivity.
• Build and enhance automation for engineering processes.
• Contribute to operational stability and documentation.

Skills

LLM-powered automation

AI-assisted review/approval flows

Data engineering

Kafka

SQL-based transformations

CI/CD pipelines

Tools

Git

Kubernetes

Bazel

Tekton

Flink

Spark

Job description

Responsibilities

• Design and implement LLM‑and agent‑assisted workflows to improve developer productivity and reliability of data pipeline delivery
• Build and enhance AI‑driven automation for engineering processes, including: pull request automation, quality gates and assistive development tooling
• Implement AI‑supported schema review and governance gates within the canonical message lifecycle
• Drive AI‑powered test automation, including automated E2E test generation and quality validation
• Develop and maintain data packaging pipelines transforming source data into canonical message formats aligned with Data Packaging Framework and Availability Layer patterns
• Build and manage SQL‑based data transformations and configuration‑driven pipelines
• Support the canonical message lifecycle, including:schema validation, versioning, compatibility checks and publishing workflows
• Contribute to framework releases, operational stability, and documentation
• Maintain and update Architecture Decision Records (ADRs)

Requirements

• Hands‑on experience building LLM‑powered automation for engineering workflows (e.g., review gates, quality checks, assistant tooling for dev/test/docs)
• Experience with AI‑assisted review/approval flows and integrating AI steps into CI/CD‑style pipelines
• Experience with AI‑assisted test generation / test automation concepts
• Strong engineering discipline around quality and safety for AI outputs (evaluation mindset, reproducibility, traceability)
• Strong experience in data engineering and distributed processing; practical delivery mindset
• Hands‑on experience with Kafka and SQL‑based transformations
• Experience with batch/stream processing frameworks (e.g., Flink or Spark)
• Familiarity with schema formats and lifecycle (e.g., JSON/Avro/XSD) and versioning/compatibility concepts
• Experience working with Git workflows and Kubernetes environments
• CI/CD and build pipeline experience (Bazel + Tekton)

Nice to have

• Experience with Data Reference Architecture / data product model
• Knowledge of Airflow, Snowflake, Iceberg, or similar data platforms
• Exposure to data governance, metadata, and lineage concepts
• Experience in banking or other regulated environments

Offer

• Private medical care
• Co‑financing for the sports card
• Constant support of dedicated consultant