Senior Data Engineer: Real-Time Pipelines & APIs

Futurae; Zürich; Hybrid; CHF 110.000 - 140.000; Vollzeit

Benefits dieser Stelle

Remote work freedom

Zurich HQ access

Annual company event

Education budget

Co-working days

Zusammenfassung

Futurae in Zürich is seeking a Data Engineer to build and scale the data backbone powering real-time security insights. The role focuses on high-throughput pipelines, robust APIs, and a reliable data lifecycle in a remote-friendly setup.

You will own data infrastructure from ingestion to storage, collaborating with ML/product teams and maintaining production-grade Python code with Ruff and Pytest. A 4+ year track record in data pipelines is required.

Qualifikationen

• Experience: minimum 4+ years building, operating, and maintaining modern data pipelines.
• Streaming: Expert-level Apache Beam and Dataflow (PySpark is a plus) or similar tools.
• GCP Data: Deep experience with BigQuery and Bigtable or similar tools.
• Python: Strong proficiency in FastAPI and asynchronous programming.
• Modern Tooling: Comfort with linting and automated testing, such as Ruff and Pytest.
• Curious & Persistent: You love digging into the \"how\" and \"why\" of complex systems.
• Proactive: You don't wait for a ticket to improve the system.
• Reliable: You take full ownership of the data lifecycle and communicate clearly in a remote setting.

Aufgaben

• Pipeline Engineering: Build and scale high-throughput streaming pipelines using Apache Beam and Dataflow.
• Storage & Ingestion: Optimize data flows into BigQuery and Bigtable for speed and reliability.
• API Ownership: Develop and maintain Python-based data APIs (FastAPI) for internal services.
• Proactive Improvement: Actively look for ways to make our data systems faster, more reliable, and easier to use.
• Technical Investigation: Dig deep into complex data anomalies to find and solve root causes.
• Collaborative Engineering: Partner with ML/Product teams to build practical, usable data schemas.
• Code Excellence: Maintain a high bar for production Python code using Poetry, Ruff, and pytest.
• Experience: 4+ years building, operating, and maintaining modern data pipelines.

Kenntnisse

Streaming pipelines

BigQuery

Bigtable

Python FastAPI

PyTest Ruff

Async programming

Data APIs

Ownership & reliability

Tools

Apache Beam/Dataflow

BigQuery tooling

PySpark

FastAPI tooling

Jobbeschreibung

Futurae in Zürich is seeking a Data Engineer to build and scale the data backbone powering real-time security insights. The role focuses on high-throughput pipelines, robust APIs, and a reliable data lifecycle in a remote-friendly setup.

You will own data infrastructure from ingestion to storage, collaborating with ML/product teams and maintaining production-grade Python code with Ruff and Pytest. A 4+ year track record in data pipelines is required.