Data Mining & OSINT Automation Specialist (m/f/d)

Arbeitsagentur; Bad Grönenbach; Hybrid; EUR 65.000 - 90.000; Vollzeit

Zusammenfassung

Arbeitsagentur in Germany seeks a Data Mining & OSINT Automation Specialist (m/f/d) for a hybrid role with remote options. You will join Project IRIS, an applied research initiative for automated spatial data analysis and open-source data modeling, building autonomous agents that feed our intelligence engine.

You will develop scalable web scrapers, parse unstructured data into relational databases, extract entities with OCR, regex, and NLP, and monitor pipelines feeding the central PostGIS Data

Qualifikationen

• Degree in Computer Science, Software Engineering, Data Analytics or equivalent experience.
• Proven web scraping experience using Python tools like Playwright, Scrapy, Selenium, and BeautifulSoup.
• Analytical mindset with data cleaning, structural modeling, and robust automation.
• Eligible for local or international applicants (Chancenkarte / Opportunity Card).
• Professional working English; German skills are a plus.

Aufgaben

• Web Automation: Develop scalable web scrapers and autonomous agents to extract data from unstructured sources.
• Data Parsing: Parse unstructured web and document data (JSON, XML, HTML, PDF) into clean, relational database structures.
• Entity Extraction: Apply OCR, regex, and NLP techniques to extract structured entities (addresses, capacities, corporate connections) from dense documents.
• Pipeline Monitoring: Automate monitoring scripts to continuously feed fresh data into our central PostGIS Data Lake.

Kenntnisse

Web scraping

Python

Playwright

Scrapy

Selenium

BeautifulSoup

English proficiency

Ausbildung

Degree in Computer Science or related field

Tools

PostGIS

Jobbeschreibung

Data Mining & OSINT Automation Specialist (m/f/d)

Location: Germany (Hybrid / Remote options available)

Contract Type: Full-Time Employment (Permanent)

Target Group: Software Engineers, Web Scrapers, OSINT Specialists, Opportunity Card Holders, and Master's Graduates

About Project IRIS Project IRIS is an applied research and technology initiative dedicated to automated spatial data analysis, infrastructure mapping, and open-source data modeling. Because not all valuable data exists as clean spatial polygons, we build systems that extract hidden knowledge from texts, complex web registries, and unstructured documents. In this role, you will build the autonomous agents that feed our intelligence engine.

Your Focus & Responsibilities

• Web Automation: Develop scalable web scrapers and autonomous agents to extract data from unstructured sources (public registers, official announcements, corporate portals).
• Data Parsing: Parse unstructured web and document data (JSON, XML, HTML, PDF) into clean, relational database structures.
• Entity Extraction: Apply OCR, regex, and NLP techniques to extract structured entities (addresses, capacities, corporate connections) from dense documents.
• Pipeline Monitoring: Automate monitoring scripts to continuously feed fresh data into our central PostGIS Data Lake.

What We Are Looking For

• Technical Background: Degree in Computer Science, Software Engineering, Data Analytics, or equivalent practical industry experience.
• Core Technical Skills: Proven experience in Web Scraping (Python, Playwright, Scrapy, Selenium, BeautifulSoup) and handling uncooperative web architectures.
• Mindset: Analytical mindset with a drive for data cleaning, structural modeling, and robust automation.
• Eligibility: Open to local applicants and international candidates (Chancenkarte / Opportunity Card supported).
• Languages: Professional working proficiency in English (required); German language skills are a plus.

What We Offer

• Full-Time Permanent Employment: Long-term career stability with clear growth trajectories.
• Dual Master / Trainee Track Available: Tailored tracks including academic coordination and complete tuition support.
• Accommodation & Onboarding Package: Structured assistance with local accommodation, official registration, and comprehensive onboarding.
• Visa & Administrative Backing: Dedicated employer support for Opportunity Card conversions and visa applications.
• Direct Mentorship: Close collaboration with experienced technical architects and executive leadership.