Senior Data Engineer: Pipelines, Spark & Azure DevOps

techcarrot FZ; Dubai; On-site; AED 240,000 - 480,000; Full time

Job summary

techcarrot FZ in Dubai seeks a data-focused engineer to lead robust data pipelines and analytics initiatives. You will collaborate with multiple engineering teams to integrate prototypes into core intelligence products, and translate complex data insights for stakeholders.

The role requires 5–7 years of practical experience, a Bachelor’s degree in a related field, and strong skills in Spark, Python, SQL, and data modeling. Expect a dynamic, on-site Dubai environment and cross-functional teamwork.

Qualifications

• Experience with relational and non-relational databases.
• Strong data analysis skills for structured and unstructured datasets.
• Proficiency in Spark, Python, Scala, SQL or equivalent languages.
• Experience building dashboards in JIRA.
• Project Management experience is a plus.
• Azure DevOps to deploy data pipelines via CI/CD.

Responsibilities

• Collect progress updates from Squad regularly.
• Consolidate updates into weekly status reports for review.
• Participate in design and feature definition activities early.
• Implement robust data pipelines using the Databricks stack.
• Create reusable and scalable data pipelines.
• Collaborate with multiple engineering teams to integrate prototypes into core intelligence products.
• Communicate complex data insights to non-technical stakeholders.
• Develop and manage L3-level project plans with detailed tasks, milestones and dependencies.

Skills

Relational and non-relational DBs

Data analysis

Spark

Python

Scala

SQL

JIRA dashboards

Project Management

Azure DevOps

Education

Bachelor's degree in CS/SE/IT or related field

Tools

Databricks Stack

Azure DevOps

JIRA dashboards

Job description

techcarrot FZ in Dubai seeks a data-focused engineer to lead robust data pipelines and analytics initiatives. You will collaborate with multiple engineering teams to integrate prototypes into core intelligence products, and translate complex data insights for stakeholders.

The role requires 5–7 years of practical experience, a Bachelor’s degree in a related field, and strong skills in Spark, Python, SQL, and data modeling. Expect a dynamic, on-site Dubai environment and cross-functional teamwork.