Remote Data Engineer: Build Scalable Pipelines & Analytics

Soum; United States; Remote; USD 120.000 - 180.000; Vollzeit

Zusammenfassung

Soum is seeking a Data Engineer to design, build, and maintain scalable data infrastructure powering analytics, ML models, and decision-making. You will create reliable data pipelines, ensure data quality, and enable data-driven insights across teams.

You will collaborate with data scientists, analysts, and product teams, optimize for performance and cost, and support cloud-based storage and governance practices in a fast-growing, remote-capable environment.

Qualifikationen

• Proficiency in Python and SQL for data engineering tasks.
• Strong understanding of ETL/ELT processes, data warehousing, and data modeling.
• Hands-on experience with cloud platforms (AWS, GCP, or Azure) and data storage solutions (BigQuery, Redshift, Snowflake, etc.).
• Familiarity with data orchestration tools Airflow, Airbyte is a must.
• Experience with containerization & deployment tools (Docker, Kubernetes) is a plus.
• Knowledge of data governance, security, and best practices for handling sensitive data. Familiarity to work with Git and GitHub.
• Dataform is a must.
• Strong skills in eliciting requirements from cross-functional stakeholders and translating them into actionable data engineering tasks.

Aufgaben

• Design, build, and maintain scalable data pipelines to support analytics, ML models, and business reporting.
• Collaborate with data scientists and analysts to ensure data is available, clean, and optimized for downstream use.
• Implement data quality checks, monitoring, and validation processes.
• Design ETL/ELT workflows and integrate multiple data sources (databases, APIs, third-party tools) into centralized storage (data lakes/warehouses).
• Support cloud-based infrastructure for data storage and retrieval.
• Monitor, troubleshoot, and optimize existing pipelines for large-scale, real-time data flows.
• Apply best practices for query optimization and cost-efficient storage.
• Partner with product, engineering, and business stakeholders to gather requirements.
• Document workflows, schemas, and processes while supporting a culture of reliability, governance, and security.

Kenntnisse

Python

SQL

ETL/ELT

Data warehousing

Data modeling

Cloud platforms

Data orchestration

Airflow

Airbyte

Dataform

Docker

Kubernetes

Git

GitHub

Governance & security

Cross-functional

Kafka

Spark

Flink

Tools

Airflow

Airbyte

Docker

Kubernetes

Git

GitHub

Dataform

BigQuery

Redshift

Snowflake

AWS

GCP

Azure

Kafka

Spark

Flink

Jobbeschreibung

Soum is seeking a Data Engineer to design, build, and maintain scalable data infrastructure powering analytics, ML models, and decision-making. You will create reliable data pipelines, ensure data quality, and enable data-driven insights across teams.

You will collaborate with data scientists, analysts, and product teams, optimize for performance and cost, and support cloud-based storage and governance practices in a fast-growing, remote-capable environment.