Senior Data Engineer

Softeta; Kraków; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Hybrid workplace model

Flexible working hours

Training budget for growth

Choice of technical equipment

Job summary

Softeta is seeking an experienced Senior Data Engineer to join a telecommunications project, leading the architecture, migration, and optimization of production data pipelines using Airflow, Spark, dbt, BigQuery, and Python.

You will drive end-to-end migration behind a regression harness, establish engineering standards, implement verification jobs, and mentor the team while collaborating with stakeholders across data platforms.

Qualifications

• Extensive hands-on data engineering with Airflow, Spark, dbt, BigQuery, and Python.
• Proven ability to lead complete pipeline migrations from design to production.
• Ability to establish engineering standards: testing, reviews, incident handling, release checklists.
• Experience documenting decisions with Architecture Decision Records (ADRs).
• Mentor or provide technical leadership within a team.

Responsibilities

• Propose and lead architecture for user-data workflows across Airflow, Spark, dbt, and BigQuery (encryption points, derived tables, backfills, partitions).
• Migrate existing pipelines behind a custom regression harness to guarantee identical output.
• Establish lasting engineering standards post-migration: code reviews, testing protocols, incident post-mortems, and release checklists.
• Implement verification jobs to validate end-to-end data lifecycle rules.
• Participate in pipeline maintenance, incident response, and root-cause resolution.
• Document design choices using Architecture Decision Records (ADRs).

Skills

Data architecture

Data migration

Technical leadership

Code reviews

Testing protocols

Incident resolution

ADR documentation

Mentoring

Tools

Airflow

Spark

dbt

BigQuery

Python

Job description

Softeta is a software engineering partner for finance, energy, industrial, and other high-stakes sectors. We specialize in building and modernizing backend-heavy, integration-critical systems where speed, accuracy, and reliability are non-negotiable. With 100+ AI and custom software experts across engineering hubs in Lithuania and Poland, we embed ourselves directly into client operations — delivering custom software, automation, and AI where they drive the most value. Clients such as SEB, NordVPN, and CarVertical trust us with systems that serve millions of users globally. We strive for excellence, that’s why we created Cobble – Softeta’s own AI-native development workflow, built by our engineers, that standardizes how developers work with AI agents from requirement to working code.

We’re looking for an experienced Senior Data Engineer to join a project in the telecommunications sector, leading the architecture, migration, and optimization of production data pipelines using Airflow, Spark, dbt, BigQuery, and Python.

Job description:

• Propose and lead the architecture for user-data workflows across Airflow, Spark, dbt, and BigQuery (encryption points, derived tables, backfills, partitions).
• Sequentially migrate existing pipelines behind a custom regression harness to guarantee identical output.
• Establish lasting engineering standards post-migration: code reviews, testing protocols, incident post-mortems, and release checklists.
• Implement verification jobs to validate end-to-end data lifecycle rules.
• Participate in pipeline maintenance, incident response, and root-cause resolution.
• Document design choices using Architecture Decision Records (ADRs).

• Deep hands-on experience with Airflow, Spark, dbt, BigQuery, and Python.
• Proven track record leading a live pipeline migration technically from conception to completion.
• Hands-on experience refactoring production pipelines while verifying identical output.
• Demonstrated success establishing engineering best practices (testing, code reviews, incident resolution) within a team.
• Concrete mentoring or technical leadership experience.

Nice to have:

• Previous experience with encryption at rest, data retention policies, or regulatory compliance (e.g., GDPR).
• Envelope encryption using key management services (GCP KMS), BigQuery AEAD functions, or Tink.
• BigQuery column-level security, policy tags, and Google Cloud Data Catalog.
• Event-driven architectures using Apache Kafka.

• Diverse and technically challenging projects.
• Training budget for professional and personal growth.
• Flexible working hours and a hybrid workplace model.
• Flexible schedule and an Agile/SCRUM environment.
• Technical equipment that you can choose.