Data Engineer

OpenSC; Deutschland; Vor Ort; EUR 60.000 - 100.000; Vollzeit

Zusammenfassung

An innovative firm is seeking a Data Engineer to enhance its data platform, crucial for transforming global food systems. This role involves designing and building data pipelines, ensuring data security, and collaborating with diverse stakeholders. With a focus on sustainability, the company leverages data to provide actionable insights for ethical production. The ideal candidate will have extensive experience in data engineering, strong Python and SQL skills, and a commitment to best practices in software engineering. Join a mission-driven team dedicated to making a positive impact on the planet.

Qualifikationen

• 6+ years of experience in building production-level data products.
• Strong foundation in core data concepts including integration and governance.
• Excellent skills in Python and SQL with experience in cloud infrastructure.

Aufgaben

• Design and build OpenSC’s data platform across all domains.
• Develop high-quality data pipelines for various data types.
• Ensure data security and efficient handling of data.

Kenntnisse

Python

SQL

Data Integration

Data Modeling

Data Security

Data Governance

Interpersonal Skills

Tools

PostgreSQL

Neo4j

Docker

Kubernetes

AWS

Git

CircleCi

Terraform

Jobbeschreibung

Join to apply for the Data Engineer role at OpenSC.

Transforming global food systems is key to tackling the climate crisis and protecting people and the planet. We believe a new and different type of transparency is needed to drive that change.

That is why we built OpenSC - co-founded by WWF and The Boston Consulting Group.

Our platform uses data directly from the source of our customer’s supply chains and analyses it to create direct actionable insights about sustainable & ethical production.

Automated - Continuous - Granular - Immutable.

This new type of transparency enables our customers to know, influence, and prove the sustainability of their supply chains.

Tasks

• Further design and build OpenSC’s data platform across all data domains: collection, storage, transformation, and analyses.
• Develop high-quality data pipelines that transform structured, semi-structured, and unstructured data from various sources into a standardized data model.
• Expand OpenSC’s data model to accommodate a growing number of use cases.
• Assume responsibility for the business interpretation of data and actively contribute to data science and analytics projects.
• Adhere to software engineering best practices regarding version control, testing, code reviews, deployment, etc.
• Provide support and guidance on data security and cloud infrastructure topics, ensuring a secure and efficient handling of data.
• Communicate effectively with technical and non-technical stakeholders.
• Contribute to elevating the team through knowledge sharing on data engineering best practices.

Requirements

• 6+ years of relevant industry experience building production-level data products.
• Proven solid foundation of core data concepts (e.g., integration, modeling, security, lineage, governance).
• Excellent Python skills and advanced competencies with main data ecosystem libraries.
• Advanced knowledge of SQL and relational databases (e.g., PostgreSQL, dbt).
• Knowledge of Cypher and graph databases (e.g., Neo4j, Kuzu, etc.).
• Experience with data pipeline orchestration tools (e.g., Dagster, Airflow, etc.).
• Experience working with cloud infrastructure and services (ideally on AWS).
• Experience working with different data modeling patterns and ability to abstract complex real-life information into a standardized data model description.
• Familiarity with Version control (Git), Containerization (Docker, Kubernetes), CI/CD (e.g., CircleCi, Github Actions), IaC (Terraform).
• Strong interpersonal skills and ability to work in a multidisciplinary and multicultural team.