Senior Software Engineer – Crawling (m/f/d)

Certivity; München; Hybrid; EUR 60.000 - 90.000; Vollzeit

Zusammenfassung

Ein innovatives Unternehmen in München sucht einen Senior Software Engineer (m/w/d), der beim Entwerfen und Erstellen leistungsstarker Web-Crawler und Datenpipelines hilft. Sie arbeiten an komplexen Herausforderungen, sind Teil eines kollaborativen Teams und gestalten technische Architekturen. Flexibles Arbeiten und eine offene Unternehmenskultur mit 30 Urlaubstagen pro Jahr warten auf Sie.

Leistungen

30 Urlaubstage pro Jahr

Flexible Arbeitszeiten

Hohe Autonomie

Qualifikationen

• 5+ Jahre Erfahrung in der Softwareentwicklung.
• Starke Fähigkeiten in Python, idealerweise auch in Go und Java/Spring Boot.
• Erfahrung in Web Scraping und Datenpipelines.

Aufgaben

• Entwicklung und Skalierung von Web-Crawlern und Scraping-Systemen.
• Design robuster Datenpipelines für Ingestion und Reinigung.
• Enge Zusammenarbeit mit Produkt- und ML-Teams.

Kenntnisse

Python

Web Crawling

Docker

CI/CD

Git

Tools

AWS

Azure

GCP

Apache Airflow

Ansible

Jobbeschreibung

About the Job

We’regrowing fast and looking for a hands-onSenior Software Engineer(m/f/d) to help us unlock and scale access to the world’s data.You’lldesign and build high-performance web crawlers, scraping systems, and data pipelines that power our next-generation products.

This is a chance to work on complex engineering challenges with massive real-world impact.You’llwork alongside a sharp, collaborative team and ship production systems end-to-end. Ifyou’repassionate about building tools that ingest, process, and deliver data at scale—we want to talk.

Your mission

What you will do

• Build and scaleweb crawlingand scraping systems that can handle dynamic, large-scale data extraction.
• Design robust pipelines for data ingestion, cleaning, and enrichment.
• Work closely with product and ML teams to deliver data-driven features.
• Deploy andoperatecontainerized apps in cloud environments (AWS, Azure, GCP).
• Improve and automate deployments withCI/CD,Ansible, or serverless stacks.
• Stay ahead of anti-botmeasures,optimizingsystems for reliability and performance.
• Contribute to technical architecture and help shape the engineering culture.

Your profile

• 5+ yearsof professional software development experience.
• Strong skills inPython(bonus:Go,Java/Spring Boot).
• Hands-on experience withweb scraping,data pipelines, and the challenges of large-scale data collection.
• Solid experience withDockerand cloud platforms (AWS, Azure, or GCP).
• ProficiencywithGit, CLI tools, and containerized deployments.
• Familiarity with tools likeApache Airflow,Ansible, or serverless architectures.
• Clear communicator who thrives in a collaborative, fast-paced environment.
• Comfortable working onsite/hybrid with a tight-knit team.

Nice to Have:

• Full-stack skills (React, Angular, or Vue) - or willingness to learn frontend quickly.
• Experience with ML pipelines, data labeling workflows, or Large Language Models (LLMs).
• Knowledge of anti-scraping measures.
• Familiaritywith Terraform, Kubernetes, and modern DevOps tooling.

Why us?

• Hybrid work in Munich.
• Flexible working time.
• 30 days of vacation per year.
• 30 days of workcation per year, in the EU and some selected countries.
• High autonomy and flat hierarchies.
• Direct access to the users and quick iteration cycles.

Closing

We welcome candidates from all backgrounds and encourage diversity in our team. We encourage diverse people to apply and join our mission-driven culture that values open communication, work-life balance, and a welcoming environment. Convince us with your personality and your skills- and together we will make great things happen!