Staff Data Engineer - Sponsored Content & Products (all genders)

ABOUT YOU SE & Co. KG; Hamburg; Vor Ort; EUR 85.000 - 100.000; Vollzeit

Zusammenfassung

ABOUT YOU SE & Co. KG in Hamburg is seeking a Staff Data Engineer. This role focuses on designing and maintaining data replication pipelines, evaluating data structure for efficiency, and migrating to scalable data architecture.

The ideal candidate will have at least 5 years of experience in data platform engineering, expertise in Python, and a strong understanding of database architectures. This position offers full-time employment with competitive compensation in a dynamic work environment.

Qualifikationen

• 5+ years of professional experience in data platform engineering.
• 7+ years of total professional experience in (general) engineering.
• Strong proficiency in Python for data loading and validation.
• Expert experience in building automated, event-driven batch architectures.
• Advanced understanding of relational and analytical database engines.
• Experience with tracking system resources and logging runtime.

Aufgaben

• Design, build and maintain high-throughput Reverse ETL replication pipelines.
• Evaluate data structure for downstream use cases and make strategic decisions.
• Lead the migration of custom data processing pipelines into a scalable architecture.
• Partner closely with engineers to map out data structures.
• Promote operational excellence across data infrastructure.

Kenntnisse

Data platform engineering

Python

Batch Workflow Orchestration

Database Architecture

Observability & Telemetry

Effective Communicator

High Autonomy

Collaborative

Tools

Datadog

Jobbeschreibung

Staff Data Engineer - Sponsored Content & Products (all genders)

• Full-time
• Compensation: EUR 85000 - EUR 100000 - yearly

Responsibilities

• Bridge Platform & Application Layers: Design, build and maintain high-throughput Reverse ETL replication pipelinesthat bridge the gap between central core platform systems and client-facing reporting tools
• Evaluate Storage & Data Modeling: Actively evaluate whether data is structured correctly for their downstream use cases. Command strategic technical decisions on whether workloads belong in relational engines (MySQL aggregates), fast search indexing layouts (OpenSearch), cloud warehouses (BigQuery), or columnar storage (ClickHouse)
• Pipeline Modernization: Take lead in the migration of our current custom data processing pipelines into a modern, scalable data architecture through a secure transition path
• Cross-Functional Information Architecture: Partner closely with Backend Engineers and Analytics Engineers to map out highly performant, scalable data structures, taking ownership over physical and logical modeling boundaries
• Drive Operational Excellence: Promote operational excellence across our data infrastructure by prioritizing proactive monitoring, system reliability, and overall application health just as much as building new pipelines
• Balance Innovation with Stability: Cultivate a very high standard of data infrastructure health, ensuring that long-term maintainability is valued equally with delivering new features

Qualifications

• 5+ years of professional experience in data platform engineering
• 7+ yearsof total professional experience in (general) engineering
• Programming Languages: Strong proficiency in Python for writing custom data loading logic, data validation drivers, and cluster-executed sync utilities
• Batch Workflow Orchestration: Expert experience building automated, event-driven batch architectures.. Skilled in configuring state tracking, asset sensors, and task dependency graphs for complex pipeline schedules
• Database Architecture: Advanced understanding of relational and analytical database engines. Expert knowledge of when to leverage transactional relational setups (MySQL transaction isolation levels, query performance tuning) versus highly optimized columnar/document architectures (ClickHouse, OpenSearch, BigQuery)
• Observability & Telemetry: Experience tracking system resources, logging pipeline runtimes, and setting up centralized data alerts within monitoring platforms like Datadog
• Pragmatic & Solution-Oriented Mindset: A practical problem solver who values executing secure, stable transition steps over premature optimization or over-engineering
• Effective Communicator: Able to convey complex architectural concepts, technical designs and performance trade-offs clearly and simply
• High Autonomy & Proactive Ownership: Motivated to work independently, take charge of data initiatives
• Collaborative: Capable of working productively alongside central infrastructure teams to align on data handoffs, platform boundaries and information architecture

Nice to have

• Modern data orchestrators: Experience with modern data orchestrators like Dagster or similar tools
• Data Transformation: Working knowledge of dbt to effectively collaborate and support analytics engineers
• Domain Expertise: Prior experience working within an e-commerce, retail tech, or ad-tech ecosystem, with a solid understanding of commercial retail workflows or funnel metrics
• Practical familiarity or comfort reading object-oriented PHP and frameworks like Laravel is a highly valued bonus, as our existing legacy pipeline and custom orchestrator live natively inside this environment