Data Engineer - ETL PySpark Banking Domain

Global Software Solutions Group; Dubai; On-site; AED 240,000 - 360,000; Full time

Job summary

Global Software Solutions Group in Dubai seeks a hands‑on Data Engineer to design, build, and support data pipelines and data marts within a banking environment.

You will own the full SDLC lifecycle—from build through UAT, deployment, and post‑production support—while handling structured, semi‑structured, and unstructured data to enable banking reporting and analytics.

Qualifications

• 5+ years of commercial experience in a data‑driven engineering role.
• Hands‑on experience building data marts and ETL pipelines.
• Expert‑level PySpark and Python for ETL scripting.
• Strong command of Oracle SQL for data analysis and debugging.
• Proven experience across the full SDLC — build, UAT, bug fixing, deployment, post‑prod support.
• Strong understanding of software engineering concepts and best practices for production pipelines.
• Experience working with structured, semi‑structured, and unstructured data.
• Prior experience with banking clients or strong banking domain knowledge.
• Strong data warehousing fundamentals.

Responsibilities

• Design, develop, and maintain ETL pipelines and data marts using PySpark and Python
• Write clean, production‑grade Python code following software engineering best practices
• Own end‑to‑end SDLC activities: build, UAT support, UAT bug fixes, production deployment, and post‑production support
• Perform data analysis and debugging using Oracle SQL and PySpark
• Work across structured, semi‑structured, and unstructured data sources
• Build and maintain data warehousing solutions supporting banking/financial reporting needs
• Debug and optimize PySpark jobs for performance and reliability
• Collaborate with cross‑functional teams (QA, DBAs, business analysts) through the release cycle
• Participate in CI/CD pipeline processes, including testing and validation of data pipelines
• Ensure data pipeline reliability, scalability, and adherence to banking data governance/compliance standards

Skills

ETL pipelines

PySpark

Python

Oracle SQL

SDLC

Data warehousing

Banking domain knowledge

Structured/semi/unstructured data

CI/CD practices

Data analysis

Tools

Jupyter

Hadoop

MapReduce

Hive

Pandas

Job description

Job Description:

Role Summary

We are looking for a hands‑on Data Engineer with strong ETL and PySpark expertise to design, build, and support data pipelines and data marts within a banking environment. The ideal candidate will own the full SDLC lifecycle — from build through UAT, production deployment, and post-production support — while working across structured, semi‑structured, and unstructured data.

Key Responsibilities

• Design, develop, and maintain ETL pipelines and data marts using PySpark and Python
• Write clean, maintainable, and production‑grade Python code following software engineering best practices
• Own end‑to‑end SDLC activities: build, UAT support, UAT bug fixes, production deployment, and post‑production support
• Perform data analysis and debugging using Oracle SQL and PySpark
• Work across structured, semi‑structured, and unstructured data sources
• Build and maintain data warehousing solutions supporting banking/financial reporting needs
• Debug and optimize PySpark jobs for performance and reliability
• Collaborate with cross‑functional teams (QA, DBAs, business analysts) through the release cycle
• Participate in CI/CD pipeline processes, including testing and validation of data pipelines
• Ensure data pipeline reliability, scalability, and adherence to banking data governance/compliance standards

Required Skills & Experience

• 5+ years of commercial experience in a data‑driven engineering role
• Hands‑on experience building data marts and ETL pipelines
• Expert‑level PySpark and Python for ETL scripting
• Strong command of Oracle SQL for data analysis and debugging
• Proven experience across the full SDLC — build, UAT, bug fixing, deployment, post‑prod support
• Strong understanding of software engineering concepts and best practices for production pipelines
• Experience working with structured, semi‑structured, and unstructured data
• Prior experience with banking clients or strong banking domain knowledge
• Strong data warehousing fundamentals

Tech Stack (Daily Use)

• Languages: Python
• Big Data: Spark / PySpark, Hadoop, MapReduce, Hive
• Data Libraries: Pandas
• Databases: SQL and NoSQL DBMS
• Tools: Jupyter
• Practices: CI/CD, data testing & validation

Nice to Have (optional — add if applicable)

• Cloud experience (AWS/Azure/GCP) — not mentioned in your input, confirm with client
• Airflow or other orchestration tools
• Experience with regulatory/compliance reporting in banking