Lead Data Engineer, Real-Time Data Platform

MVP Ventures; Dubai; On-site; AED 734,000 - 1,469,000; Full time

Benefits offered by this job

Equity

Job summary

MVP Ventures in San Francisco is hiring the first dedicated data engineer to own the full data stack—from ingestion to real-time streaming. You will architect and optimize a data warehouse, oversee dbt models, and build robust pipelines that scale as the user base grows.

You’ll partner with data science and engineering to translate insights into production decisions. The role emphasizes autonomy, architectural decision-making, and building from zero in a fast-moving environment.

Qualifications

• Strong software engineering fundamentals.
• Deep experience with SQL and Python in production data contexts.
• Hands-on experience with data warehousing (BigQuery, Snowflake, Redshift, or similar) and transformation frameworks (dbt strongly preferred).
• Experience building and operating data pipelines with orchestration tooling (Airflow, Dagster, Prefect, or similar).
• Understanding of data modeling patterns (dimensional modeling, slowly changing dimensions, incremental materialization).
• Ability to work independently and make sound architectural decisions.

Responsibilities

• Architect and own the data warehouse. Design and optimize our BigQuery environment for performance, cost, and reliability as data volumes scale with user growth.
• Build and maintain transformation layers. Own our dbt project end-to-end, including models, testing, documentation, and CI/CD, turning raw event streams into clean, trusted datasets.
• Pipeline orchestration. Build and manage robust data pipelines with proper orchestration, monitoring, alerting, and failure recovery.
• Real-time data systems. Design and implement streaming infrastructure for use cases where batch processing falls short: live game economics, real-time risk signals, and in-session player behavior.
• Reverse ETL and production integration. Close the loop between model outputs and the product by getting scores, segments, and predictions back into production systems.
• Data quality and reliability. Build the testing, validation, and monitoring frameworks that let a small team trust the data at scale.
• Partner with DS and engineering. You'll sit between two teams that move fast and need different things from the data layer.

Skills

SQL

Python

Software engineering fundamentals

Independent work

Tools

BigQuery

Snowflake

Redshift

dbt

Airflow

Dagster

Prefect

Job description

MVP Ventures in San Francisco is hiring the first dedicated data engineer to own the full data stack—from ingestion to real-time streaming. You will architect and optimize a data warehouse, oversee dbt models, and build robust pipelines that scale as the user base grows.

You’ll partner with data science and engineering to translate insights into production decisions. The role emphasizes autonomy, architectural decision-making, and building from zero in a fast-moving environment.