Senior Data Engineer

CloudDevs; Poland; Hybrid; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Flexible working arrangements

Health benefits

Job summary

Simon-Kucher is seeking an experienced Senior Data Engineer to design and build scalable data architectures for AI-powered SaaS products in our AI Lab. You will craft batch and streaming pipelines, manage data quality and security, and collaborate across product, ML, and engineering teams.

The role emphasizes Python/SQL, Spark/Flink, and cloud-native data services, with a focus on open table formats and data governance. Flexible, remote-friendly work is encouraged.

Qualifications

• 6+ years of data engineering experience at scale.
• Strong Python/SQL and streaming/batch processing skills.
• Experience with Spark or Flink and Parquet/columnar formats.
• Knowledge of data governance, security, and privacy requirements.

Responsibilities

• Develop and maintain scalable data architectures for high-volume SaaS applications.
• Design batch/stream pipelines with CDC, API, and file-based sources.
• Integrate internal and external data sources (structured and unstructured).
• Model core entities and features; choose storage layouts and partitioning.
• Implement entity resolution and fuzzy matching; evaluate matching quality.
• Build ETL/ELT processes to load data into warehouses or lakes.
• Ensure data quality, validation, encryption, and access controls.
• Own orchestration, lineage, and observability; define SLAs and error budgets.
• Partner with Product Owner to translate needs into scalable data/ML solutions.
• Collaborate with ML/MLOps on feature pipelines; work with Cloud Platform Engineer.

Skills

Python/SQL

Spark/Flink

Data modeling

Airflow/Argo

Terraform/CDK

AWS data services

Security governance

Kafka/MSK/Kinesis

Open table formats

dbt

Tools

Airflow

Kubernetes

dbt

Iceberg

Delta Lake

Kinesis

Job description

We are seeking an experienced Senior Data Engineer to contribute to designing and building scalable SaaS products within our AI Lab. In this role, you’ll combine deep technical expertise with strategic vision to build AI-powered products that will help transform our clients’ business models and enable their growth.

Simon-Kucher is at the forefront of innovation in driving commercial excellence, revamping business models, developing solutions and methodologies for unlocking better growth of our clients. Within AI Lab, we are developing cutting‑edge large scale AI products to deliver sustained top‑line impact for our clients.

Are you interested in working in a team of AI evangelists with a can‑do attitude? Want to experience the dynamics of agile processes in open‑minded teams? How about getting creative in a startup atmosphere with a steep development curve and flat hierarchies? And most importantly, do you want to make a difference? Then you’ve come to the right place.

What makes us special:

• Become part of a unique entrepreneurial team. Think independently, use your initiative, and take some risks. Entrepreneurship is a powerful force that drives the growth not only of our firm but our clients and people.
• Unlock the power of opportunity. Advance your career in a thriving company that creates positive impact. We invest in your professional development every step of the way.
• Enjoy balance and flexible working. Be empowered to do your best work – whether it’s remotely or in the office.
• Prioritize your health and wellbeing. No matter where you live, we offer a competitive suite of health benefits to help keep you and your loved ones safe.
• Work in a values‑driven culture. At Simon‑Kucher, our vision is to become the world’s leading growth specialist. Our values guide the way we do business and communicate our distinctiveness. They sum up what we stand for, influence our culture, and drive how and why we do things.

How you will create an impact:

• Develop and maintain data architecture: create and manage robust data architectures that support high-volume, high-throughput SaaS applications, focusing on reliability and scalability.
• Design and implement batch/stream pipelines (CDC, API, files) with schema evolution, idempotency, and data quality gates.
• Integrate internal and external data sources, structured and unstructured (e.g., pricing databases, market benchmarks, CRM).
• Model core entities and features; choose storage layouts and partitioning; build reusable data products.
• Implement entity resolution and fuzzy matching; evaluate and tune matching quality.
• Implement ETL/ELT processes: develop processes for extracting, transforming, and loading data from multiple sources into data warehouses or lakes for analytical use.
• Ensure data quality and security: implement data validation, cleansing routines, and security measures, including encryption and access controls, to ensure data accuracy, privacy, and compliance with regulations.
• Own orchestration, lineage, and observability; define SLAs and error budgets.
• Partner with Product Owner to translate customer needs into scalable data and ML solutions.
• Partner with ML/MLOps on feature pipelines.
• Work with Cloud Platform Engineer to deploy and manage services securely.

Your profile:

• 6+ years in data engineering at scale; strong Python/SQL; Spark or Flink; Parquet/columnar formats.
• Experience with big data processing frameworks like Apache Spark and messaging systems like Kafka.
• Orchestration (Airflow/Argo/Step Functions); IaC (Terraform/CDK) basics.
• Data modeling for analytics/ML; partitioning, z-ordering/clustering; performance tuning.
• Experience with probabilistic linkage/fuzzy matching (e.g., blocking, string similarity, Fellegi–Sunter-style models).
• Proficiency with cloud-native services on AWS for data processing and storage. Knowledge of Azure is nice to have.
• Databases: Experience with various SQL and NoSQL databases.
• Security & governance (PII handling, encryption, IAM, row/column-level policies).
• Open table formats (Iceberg/Delta/Hudi); dbt; Kafka/MSK/Kinesis; Great Expectations/Deequ.
• Ability to analyze complex datasets and design efficient data solutions.
• Strong ability to collaborate effectively with cross-functional teams.
• Excellent communication skills to explain technical concepts to both technical and non-technical stakeholders.
• Strong understanding of AI/ML concepts for effective collaboration with data scientists.

About Simon‑Kucher

Simon‑Kucher is a global consultancy with more than 2,000 employees in 30 countries.

Our sole focus is on unlocking better growth that drives measurable revenue and profit for our clients. We achieve this by optimizing every lever of their commercial strategy – product, price, innovation, marketing, and sales – based on deep insights into what customers want and value. With 40 years of experience in monetization topics of all kinds, we are regarded as the world’s leading pricing and growth specialist.

We believe in building a culture that embraces diversity, equity, and inclusion, creating an environment in which our people feel valued, are able to be themselves and feel their contribution matters. If we get that right, remarkable things will happen; people will grow faster, innovate, feel valued, and create better outcomes for everyone – our people, our clients and, of course, our business.