Senior Data Engineer

Cognism; Lérida; A distancia; EUR 50.000 - 80.000; Jornada completa

Descripción de la vacante

A leading B2B data company is seeking a Senior Data Engineer to design and build high-performance microservices and data processing pipelines. The role involves developing scalable data solutions using Apache Spark and AWS tools. Ideal candidates should have 6+ years of experience in software engineering, particularly with distributed systems. This is a flexible remote or hybrid position based in Spain, Cataluña.

Servicios

Inclusive and diverse workplace

Flexible work environment

Formación

• 6+ years in software engineering, ideally with a focus on distributed systems.
• Proficiency in Scala or a similar strongly typed language.
• Expertise in Apache Spark and performance tuning for data jobs.

Responsabilidades

• Develop and maintain scalable batch and streaming data pipelines.
• Build high-quality microservices integrated into a data processing platform.
• Ensure reliable and performant production systems.

Conocimientos

Software Engineering

Distributed Systems

Scala

Apache Spark

AWS Services

Microservices

Kafka

Code Cleanliness

Herramientas

AWS Glue

ECS

EC2

Play Framework

Terraform

Descripción del empleo

Cognism is the leading provider of European B2B data and sales intelligence. Ambitious businesses of every size use our platform to discover, connect, and engage with qualified decision-makers faster and close more deals. Headquartered in London with global offices, Cognism’s contact data and contextual signals are trusted by thousands of revenue teams to eliminate the guesswork from prospecting.

Remote or Hybrid: This is a remote or hybrid role, requiring you to work either remotely or one of our local offices depending on your location.

Your Role

As a Senior Data Engineer, you’ll bring your strong software engineering background and deep expertise in scalable, distributed data systems to design and build high-performance, production-grade microservices and cloud-native data processing pipelines. This role sits at the heart of our Data Engineering function, helping us evolve a modern, event-driven ecosystem that powers Cognism’s core data products.

Responsibilities

• Design & Build at Scale – Develop and maintain scalable batch and streaming data pipelines using Apache Spark, AWS Glue, and broader AWS tools.
• Develop Robust Microservices – Build high-quality services in Scala (Play Framework and Pekko), integrated into a distributed data processing platform.
• Own Production Systems – Deploy services using ECS or EC2, ensuring systems are reliable, scalable, and performant.
• Drive Technical Excellence – Identify and resolve bottlenecks in existing systems, applying strong engineering practices and performance tuning.
• Be a Technical Leader – Mentor teammates, drive architectural decisions, and elevate the overall engineering bar.
• Collaborate Cross-Functionally – Work closely with data, engineering, and platform teams to design cloud-native and event-driven solutions.
• Champion Best Practices – Improve our CI/CD pipelines, testing coverage, and developer experience.
• Own End-to-End Delivery – Take responsibility for services and systems from design through to production operations.

Qualifications

• Experienced Engineer – 6+ years in software engineering, ideally with a focus on distributed systems or large-scale data platforms.
• Scala Expertise – Proficiency in Scala or a similar strongly typed, object-oriented or functional language.
• Advanced Data Skills – Expertise in Apache Spark and performance tuning for large-scale data jobs.
• Cloud-Native Mindset – Experience with AWS services such as Glue, Lambda, S3, DynamoDB, Step Functions, EventBridge, API Gateway, ECS, and EC2.
• Systems Thinking – Strong grasp of microservices, reactive and event-driven architecture, batch vs streaming patterns, and scalable system design.
• Message Broker Mastery – Hands-on experience with Kafka (Confluent) and/or RabbitMQ.
• Modern Data Lakes – Familiarity with Apache Iceberg or similar formats like Delta Lake or Hudi.
• Software Engineering Craftsmanship – CI/CD, testing, clean code, and maintainable service design.
• Excellent Communicator – Strong communication skills with a collaborative and ownership-driven mindset.

Nice to Have

• Experience developing Scala microservices with Play Framework or Pekko
• AWS Glue job optimization or EMR experience
• Familiarity with schema evolution, data contracts, or data versioning
• Exposure to data governance, lineage, or compliance tooling
• Experience with Infrastructure as Code (Terraform or CloudFormation)
• Knowledge of domain-driven design (DDD), event sourcing, or CQRS patterns

Why Cognism

At Cognism, we’re not just building a company - we’re building an inclusive community of brilliant, diverse people who support, challenge, and inspire each other every day. If you’re looking for a place where your work truly makes an impact, you’re in the right spot!

Our values aren’t just words on a page—they guide how we work, how we treat each other, and how we grow together. They shape our culture, drive our success, and ensure that everyone feels valued, heard, and empowered to do their best work.

Here’s What We Stand For

We Are Nice! We treat each other with respect and kindness (because life’s too short for anything else).

We Are Collaborative. We’re in this together—great things happen when we work as one.

We Are Solution-Focused. Every challenge is just an opportunity in disguise.

We Are Understanding. We empower and support each other to do our best work.

We Celebrate Individual Contributors. Every role matters, and so do you!

At Cognism, we are committed to fostering an inclusive, diverse, and supportive workplace. Our values—Being Nice, Collaborative, Solution-Focused, and Understanding—guide everything we do, and we celebrate Individual Contributors. We welcome applications from individuals typically underrepresented in tech, so if this role excites you but you’re unsure if you meet every requirement, we encourage you to apply!