Senior Data Engineer

QuoIntelligence SRL; Deutschland; À distance; EUR 72 000 - 88 000; Plein temps

Résumé du poste

QuoIntelligence is seeking a data engineer to own the full data stack for cybersecurity intelligence. You will design and operate pipelines powering the Mercury platform and analyst workflows, collaborating closely with a small team.

The role emphasizes architectural decision-making, working across the stack from ingestion to modeling, and leading an AWS migration while maintaining existing infrastructure.

Qualifications

• Must have Python for data engineering.
• Strong foundation in pipeline design from ingestion to modeling.
• Experience deploying and debugging containerized services (Docker).
• Experience building custom infrastructure solutions when off-the-shelf tools don’t fit.
• Cloud experience (AWS preferred; GCP/Azure also relevant).
• Knowledge of microservices and distributed systems.
• Professional English communication.

Responsabilités

• Build and design data pipelines for ingestion, processing, and modeling that feed Mercury and analyst workflows.
• Partner with Threat Intelligence Engineers on data access patterns and evolving data sources.
• Help shape the technical direction with two engineers.
• Maintain the DigitalOcean-based platform: containers, libraries, and custom services.
• Lead the AWS migration with measurable milestones.

Connaissances

Python

Data pipelines

Docker

Go

Cloud platforms (AWS)

Distributed systems

Microservices

English proficiency

Outils

ZMQ

Redis

AWS

Kubernetes

Description du poste

The Opportunity

You'll own the full data stack for cybersecurity intelligence at QuoIntelligence, building and evolving the pipelines that power our Mercury platform and analyst workflows. This is a role where your architectural decisions have real, visible impact, and where you'll collaborate closely with a small, expert team of two engineers on the data side. Our platform runs on DigitalOcean with a custom-built infrastructure: ZMQ message queues, Docker containers, hand-rolled deployment pipelines, and in-house-maintained Python libraries. It was built before today's managed services existed, and it works because engineers who genuinely understood distributed systems built it from the ground up. The first major project is leading our migration to AWS, transitioning from this custom infrastructure to managed services, without disrupting production. It's the kind of challenge that requires both depth and adaptability: keeping what exists healthy while architecting what comes next. If you thrive in that kind of dual mandate, this role was designed for you.

You’ll Thrive Here If...

You enjoy working across the full stack rather than specializing deeply in one layer. You're energised by inheriting a well-built yet unconventional system and improving it. You're comfortable with ambiguity and find it motivating rather than frustrating. And you want your work to matter not just to a ticket queue, but to the analysts and products that rely on it every day.

What You’ll Do

• Build and design data pipelines for ingestion, processing, and modeling of cybersecurity intelligence that feeds Mercury and analyst workflows
• Partner with Threat Intelligence Engineers on data access patterns, tool integration, and evolving data sources as priorities shift
• Shape the team's technical direction with two engineers, your judgment carries weight
• Keep the existing DigitalOcean platform running: manage containers, handle library updates, and debug custom services with confidence
• Lead the AWS migration: plan and execute the transition to managed services, with measurable benchmarks at every phase

AI-First in Data Engineering

AI is an operating principle here. We use AI tools as a core part of how we work. On a lean team maintaining hand‑built infrastructure, they're what let us move at the pace of a much larger engineering org.

AI as an operating system. You use Copilot, Claude, Cursor (or equivalents) daily to navigate Go services you didn't write, debug custom ZMQ queues, and generate Docker configurations as part of your daily workflow.

Evaluate, Integrate, Repeat. Not every AI-generated suggestion belongs in a pipeline processing cybersecurity intelligence data. You test tools against QI's actual problems (migrating custom services to AWS, parsing threat feed data, maintaining manually versioned Python libraries) and drop what doesn't hold up in production.

Define success first. Every pipeline feeding Mercury has defined criteria before it ships: ingestion throughput, data freshness, and error rates. We run the AWS migration on measurable benchmarks at each phase, not just "it works on staging." AI accelerates the testing loop, but the loop needs a target.

What You’ll BringMust-haves

• Python as your primary language for data engineering work
• A solid foundation in pipeline design, you can reason about data from ingestion through modeling
• Docker fluency: deploying, debugging, and managing containerized services is routine for you
• Experience building custom solutions when no off-the-shelf solution fits, writing the infrastructure yourself, not just assembling managed services
• Cloud platform experience (AWS preferred, GCP, or Azure also relevant): enough to architect the target state of a managed-services migration
• Microservices architecture or distributed systems: you've designed or maintained service-oriented systems
• Working familiarity with Go: you'll read, debug, and modify Go code in some production services. Side projects and CLI tools count; we expect a ramp-up period
• You'll also need professional proficiency in English (the team works across countries).

Nice-to-Haves

• Redis or ZMQ experience for message queuing
• Legacy system maintenance: keeping aging infrastructure healthy while building its replacement
• Cybersecurity or threat intelligence background

Recruitment Process

1. Recruiter Screen
2. Take-Home Assignment
3. Technical Interview
4. Culture Add Interview
5. Offer & Background Check

About QuoIntelligence

Founded in Germany in 2020, QuoIntelligence is Europe’s leading provider of Unified Risk Intelligence – a strategic fusion of Threat Intelligence, Digital Risk Protection, and Risk Intelligence services. We enable organizations to proactively identify and mitigate cyber, geopolitical, and physical risks with intelligence tailored to their unique threat landscape.

Unlike traditional feed-based solutions, every client benefits from our analysts' work supported by Agent Karla’s automation and our proprietary Mercury platform, ensuring high-quality intelligence with low operational friction.

Deeply embedded in the European regulatory and operational context, and with legal entities in Germany, Italy, and Spain, QuoIntelligence is the trusted partner to critical infrastructure operators, significant financial institutions, government agencies and enterprises across the EU.

We welcome applications regardless of gender, nationality, ethnic origin, religion, disability, age, or sexual identity. Diversity is key to producing high-quality intelligence.

Job Types: Full-time, Permanent

Pay: From 80.000,00€ per year

Work Location: Remote