Data engineer in e-commerce

SOUM; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Soum ищет инженера по данным для разработки масштабируемых конвейеров данных, поддержки моделей ML и бизнес-отчетности. Вы будете тесно сотрудничать с учеными данными и аналитиками, обеспечивая чистые и доступные данные.

Требуется опыт в Python, SQL, ETL/ELT, работе с облачными платформами и инструментами оркестрации данных (Airflow/Airbyte). Предпочтение кандидатам с опытом в Git, Docker/Kubernetes и обработке реальных потоков данных.

Qualifications

• Владение Python и SQL для задач data engineering.
• Понимание ETL/ELT, моделирования данных и DW.
• Опыт работы с облачными платформами и хранилищами данных.
• Знание Airflow и Airbyte.
• Знание принципов управления данными и безопасности.
• Опыт работы с Git и GitHub.
• Dataform; плюс Docker/Kubernetes и обработка потоков.

Responsibilities

• Разработка, построение и поддержка масштабируемых конвейеров данных и аналитических пайплайнов.
• Сотрудничество с data-science командами и аналитиками.
• Обеспечение качества, мониторинга и валидации данных.
• Интеграция данных из нескольких источников в центры хранения данных.
• Поддержка облачной инфраструктуры для хранения и доступа к данным.
• Оптимизация запросов и затрат на хранение.
• Документация рабочих процессов, схем и процедур.

Skills

Python

SQL

Data warehousing concepts

Data modeling

Git basics

Tools

Airflow

Airbyte

AWS

GCP

Azure

BigQuery

Redshift

Snowflake

Docker

Kubernetes

Kafka

Spark

Flink

Git

GitHub

Dataform

Job description

Описание

Soum is on a mission to revolutionize e-commerce in the MENA region and beyond by building the most convenient and trustworthy re-commerce marketplace in the region. We're reshaping how C2C marketplaces operate, making buying and selling second-hand products seamless and reliable. Since our launch in July 2021, Soum has become one of the fastest-growing startups in the region, achieving rapid expansion in both our team and product offerings. In recognition of our impact and growth, we were proudly named one of the Top 10 LinkedIn Startups in Saudi Arabia for 2024.

Задачи

Design, build, and maintain scalable and reliable data pipelines to support analytics, ML models, and business reporting. Collaborate with data scientists and analysts to ensure data is available, clean, and optimized for downstream use. Implement data quality checks, monitoring, and validation processes. Design efficient ETL/ELT workflows and integrate multiple data sources (databases, APIs, third-party tools) into centralized storage (data lakes/warehouses). Support cloud-based infrastructure for data storage and retrieval. Monitor, troubleshoot, and optimize existing pipelines for large-scale, real-time data flows. Apply best practices for query optimization and cost-efficient storage. Partner with product, engineering, and business stakeholders to gather requirements. Document workflows, schemas, and processes while supporting a culture of reliability, governance, and security.

Требования

• Proficiency in Python and SQL for data engineering tasks.
• Strong understanding of ETL/ELT processes, data warehousing, and data modeling.
• Hands-on experience with cloud platforms (AWS, GCP, or Azure) and data storage solutions (BigQuery, Redshift, Snowflake, etc.).
• Familiarity with data orchestration tools Airflow, Airbyte is a must.
• Knowledge of data governance, security, and best practices for handling sensitive data.
• Familiarity to work with Git and GitHub.
• Dataform is a must Strong skills in eliciting requirements from cross-functional stakeholders and translating them into actionable data engineering tasks.
• Preferably total 4 years of experience 2+ years in data engineering, building and maintaining data pipelines.
• 2+ years of SQL and Python development in production environments.
• Будет плюсом: Experience with containerization & deployment tools (Docker, Kubernetes) is a plus; Experience working in Fast-growing startup environments is a plus; Exposure to real-time data processing frameworks (Kafka, Spark, Flink) is a plus

Условия

Be part of a fast-scaling Saudi marketplace where Finance has real influence over how the business is run. Work directly with senior Finance leadership and gain broad exposure across accounting, audit, and financial operations. A culture that values ownership, speed, and constant improvement over hierarchy and red tape.