Senior Data Engineer

Exinity; Dubai; Hybrid; AED 300,000 - 400,000; Full time

Job summary

A leading fintech company based in Dubai is seeking a highly experienced Senior Data Engineer. You will focus on building scalable data pipelines using Azure Databricks, with a strong emphasis on performance and real-time analytics. Candidates should have over 5 years of experience in data engineering and proficiency in PySpark, SQL, and Python. The role offers a hybrid working policy and comprehensive benefits package.

Benefits

Hybrid Working Policy

Discretionary performance related bonus

Personalized Flex-Benefits

Wellbeing support

Medical insurance for employees

Comprehensive leave package of 40 days

Qualifications

• 5+ years of experience in data engineering, with at least 2 years working with Azure Databricks.
• Experience supporting production pipelines, including monitoring, alerting, and troubleshooting.
• Azure certifications (e.g., Azure Data Engineer Associate).

Responsibilities

• Design, develop, and maintain robust data pipelines using Azure Databricks.
• Self-study and enhance existing data pipelines.
• Administer Databricks workspaces and ensure performance improvements.
• Build and maintain CI/CD pipelines using GitLab.

Skills

Azure Databricks

PySpark

SQL

Python

GitLab CI/CD

Kafka

Education

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field

Job description

Overview

We are seeking a highly experienced Senior Data Engineer with strong expertise in Azure Databricks. This role will focus on building, supporting, and administering scalable, high-performance data pipelines that power real-time and batch analytics for trading, risk, and operational use cases. The ideal candidate will have a deep background in Databricks data engineering, administration, capital markets data, and thrive in an Agile, fast-paced environment.

Responsibilities

• Design, develop, and maintain robust data pipelines using Azure Databricks, Confluent, DLT, Spark, and Delta Lake to support trading and market data workflows.
• Self-study the existing pipeline and enhance existing data pipelines, ensuring continuity, scalability, and performance improvements.
• Production pipeline support services, including job monitoring, incident resolution, and performance tuning in production environments.
• Administer Databricks workspaces, Unity Catalog, including cluster configuration, job scheduling, access control, and workspace optimization.
• Build and maintain CI / CD pipelines using GitLab, enabling automated testing, deployment, and versioning of data engineering code.
• Follow and enforce best practices in code management, including modular design, code reviews, and documentation using GitLab workflows.
• Collaborate with fellow team members, business analysts, and data architects to understand data requirements and deliver high-quality solutions.
• Build reusable components and frameworks to accelerate development and ensure consistency across data platforms.
• Actively participate in Agile ceremonies (e.g., sprint planning, stand-ups, retrospectives) and contribute to continuous improvement of team processes.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering, with at least 2 years working with Azure Databricks.
• Strong proficiency in PySpark, SQL, and Python.
• Experience supporting production pipelines, including monitoring, alerting, and troubleshooting.
• Experience with GitLab CI / CD, including pipeline configuration, runners, and integration with cloud services.
• Familiarity with financial capital markets domain, such as market data feeds, order books, trade execution, and risk metrics.
• Proven ability to work effectively in Agile development environments.
• Azure certifications (e.g., Azure Data Engineer Associate).
• Experience with real-time data processing using Kafka or Event Hubs.

Benefits & Perks

We believe in fairly compensating all our people by providing them with a world-class health insurance plan and a range of both core benefits and flex benefits for individual preferences. You will receive:

• Hybrid Working Policy
• Discretionary performance related bonus
• Personalized Flex-Benefits
• A focus on your wellbeing, including talks and access to self-development tools.
• Medical insurance for employees.
• Comprehensive leave package of 40 days inclusive of Public Holidays

What you will love about Exinity

"Freedom to succeed" is our core belief. It’s not just a promise we make to our clients and partners, but to our people too. We want our people to LEAP and so in this role you will…

Learn (e.g., from each other / from new projects).

Exchange (e.g., information and best practices in an open-minded environment).

Advance (e.g., by developing skills and accepting greater responsibilities / your career progression and diversification).

Prosper (e.g., by acquiring skills / by nurturing a team of x people).

Exinity is an equal opportunities employer and positively encourages applications from suitably qualified and eligible candidates regardless of gender, sexual orientation, marital or civil partner status, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.