Data Platform Engineer: Build Reliable Pipelines

PRYPCO; Dubai; On-site; AED 240,000 - 420,000; Full time

Job summary

PRYPCO is seeking a Software Engineer (Data) to design and operate a reliable data platform that supports decision-making across the company. You will own end-to-end problems from architecture to automation and work closely with product, engineering, and data science teams.

You will design, implement, and maintain scalable ETL pipelines, establish data standards, and help users via dashboards and internal tools. A strong background in Python, SQL, and Airflow is required.

Qualifications

• Bachelor's or Master's degree in Computer Science or a related field, or equivalent practical experience.
• Strong proficiency in Python, SQL, and Unix shell scripting.
• Hands‑on experience with Agile engineering practices, including TDD, refactoring, CI/CD, and XP.
• Proven experience designing, implementing, and maintaining custom ETL pipelines.
• Experience with workflow orchestration tools such as Apache Airflow.
• Expertise in distributed data processing and query engines, including Trino, Apache Spark, Snowflake, and BigQuery.

Responsibilities

• Design, build, and maintain efficient, reliable data platforms, streamlining end-to-end data pipelines and automating manual workflows.
• Partner with cross-functional teams to translate ambiguous requirements into practical, scalable solutions.
• Establish and enforce data standards, maintain comprehensive documentation, and manage the company-wide data registry.
• Onboard and support platform users while communicating updates and insights through dashboards, bots, and other internal tools.
• Plan and execute organization-wide platform improvements, defining best practices for coding, testing, deployment, and maintenance.
• Use data to guide engineering decisions and continuously improve platform performance and reliability.

Skills

Python

SQL

Unix shell scripting

Agile engineering practices

TDD

refactoring

CI/CD

XP

data-driven decisions

Education

Bachelor's or Master's in Computer Science

Tools

Apache Airflow

Trino

Apache Spark

Snowflake

BigQuery

Docker

Kubernetes

Terraform

Job description

PRYPCO is seeking a Software Engineer (Data) to design and operate a reliable data platform that supports decision-making across the company. You will own end-to-end problems from architecture to automation and work closely with product, engineering, and data science teams.

You will design, implement, and maintain scalable ETL pipelines, establish data standards, and help users via dashboards and internal tools. A strong background in Python, SQL, and Airflow is required.