Remote Data Engineer — Real-Time Pipelines & Production

Suntech Innovation; United Arab Emirates; Hybrid; AED 180,000 - 320,000; Full time

Benefits offered by this job

Hybrid or remote working

Job summary

Suntech Innovation in the United Arab Emirates is seeking a data engineer to build the data pipelines powering experimentation and production systems. You will work mainly with Kafka, Spark on Databricks, and Airflow, modeling data for both experimentation and production serving, and partnering closely with data scientists and backend engineers on data contracts.

Requirements include 3+ years in data engineering or software engineering for data, strong Python (including PySpark), Kafka,

Qualifications

• 3+ years of data engineering or software engineering for data.
• Strong Python, including PySpark.
• Kafka and stream processing experience.
• Databricks experience and Airflow or equivalent.
• Strong SQL and data modeling with relational databases.
• Software engineering mindset and production-readiness.

Responsibilities

• Build and operate batch and streaming data pipelines (structured & unstructured data).
• Work primarily with Kafka, Spark on Databricks, and Airflow.
• Model and optimize data for both experimentation and production serving.
• Partner with data scientists and backend engineers on data contracts and reliability.
• Own pipeline quality: testing, monitoring, and performance.
• Participate in on-call rotation for the pipelines you build and operate.

Skills

Python

PySpark

Kafka

Airflow

Databricks

SQL

Data Modeling

Software Engineering Mindset

Tools

Kafka

Spark

Databricks

Docker

Kubernetes

Job description

Suntech Innovation in the United Arab Emirates is seeking a data engineer to build the data pipelines powering experimentation and production systems. You will work mainly with Kafka, Spark on Databricks, and Airflow, modeling data for both experimentation and production serving, and partnering closely with data scientists and backend engineers on data contracts.

Requirements include 3+ years in data engineering or software engineering for data, strong Python (including PySpark), Kafka,