Big Data & Backend Engineer – Spatial ETL (m/f/d)

Arbeitsagentur; Bad Grönenbach; Hybrid; EUR 80.000 - 110.000; Vollzeit

Benefits dieser Stelle

Accommodation & Onboarding

Visa & Administrative Backing

Master/Trainee Track

Hybrid/Remote options

Zusammenfassung

Arbeitsagentur is seeking a Big Data & Backend Engineer – Spatial ETL to own heavy data loads and robust backend pipelines in a hybrid/remote setup across Germany.

You'll automate ingestion of massive data dumps, build high-performance ETL pipelines with Python (SQLAlchemy, Pandas) into PostgreSQL with PostGIS, and ensure data integrity and scalability.

This permanent role offers long-term stability, a partnership-friendly track, visa support, and onboarding assistance.

Qualifikationen

• Degree in Computer Science, Software Engineering, or equivalent.
• Strong Python skills with SQLAlchemy and Pandas.
• Experience with large-scale relational data and PostgreSQL tuning.
• Fluent English; German a plus.
• Eligible to work in Germany (local or visa-supported).

Aufgaben

• Bulk Processing: Automate download and processing of massive data dumps.
• ETL Engineering: Build high-performance pipelines into PostgreSQL.
• Database Governance: Ensure idempotency, deduplication, monitoring.
• Container Orchestration: Manage Docker environments for ingestion tasks.

Kenntnisse

Python

SQLAlchemy

Pandas

PostgreSQL

Data processing

Docker

Ausbildung

Degree in Computer Science or Software Engineering

Tools

Docker

PostGIS

PostgreSQL

Jobbeschreibung

Big Data & Backend Engineer – Spatial ETL (m/f/d)

Location: Germany (Hybrid / Remote options available)

Contract Type: Full-Time Employment (Permanent)

Target Group: Backend Engineers, Data Engineers, Database Administrators, Opportunity Card Holders, and Master's Graduates

About Project IRIS Project IRIS is a proprietary applied research initiative processing massive amounts of infrastructure and spatial data. We bridge the gap between fragmented public data and actionable infrastructure intelligence. When standard APIs reach their limits and entire national registries must be processed, you step in. In this role, you are the architect for heavy data loads and robust backend pipelines.

Your Focus & Responsibilities

• Bulk Processing: Automate the download and processing of massive data dumps (e.g., corporate registers, industrial emission databases like PRTR, energy grids).
• ETL Engineering: Program high-performance ETL pipelines that decompress, parse, and transfer complex archives into our central PostgreSQL architecture.
• Database Governance: Ensure idempotency, deduplication, and reliable monitoring during weekly multi-million row updates.
• Container Orchestration: Deploy and maintain isolated Docker environments for all ingestion tasks.

What We Are Looking For

• Technical Background: Degree in Computer Science, Software Engineering, or extensive practical backend industry experience.
• Core Technical Skills: Expertise in processing relational mass data, strong Python skills (SQLAlchemy, Pandas), and deep PostgreSQL performance tuning.
• Mindset: A clean-code engineering approach focused on system stability and scalability.
• Eligibility: Open to local applicants and international candidates (Chancenkarte / Opportunity Card supported).
• Languages: Professional working proficiency in English (required); German language skills are a plus.

What We Offer

• Full-Time Permanent Employment: Long-term career stability with clear growth trajectories.
• Dual Master / Trainee Track Available: Tailored tracks including academic coordination and complete tuition support.
• Accommodation & Onboarding Package: Structured assistance with local accommodation, official registration, and comprehensive onboarding.
• Visa & Administrative Backing: Dedicated employer support for Opportunity Card conversions and visa applications.
• Modern Tech Environment: Work in a high-efficiency environment centered on Python, PostGIS, and Docker.