Python Engineer | UAE

Tech Junction Ltd; United Arab Emirates; On-site; AED 240,000 - 360,000; Full time

Job summary

IDC Technologies is seeking a highly skilled Python Engineer in the UAE to design, build, and optimize scalable backend microservices and data pipelines. You will craft RESTful APIs using Flask, FastAPI, and Django, and work with Spark and PySpark on large datasets.

The role requires 5+ years of backend experience, strong R programming skills, and hands-on containerization with Docker and Kubernetes, plus CI/CD and Git workflows.

Qualifications

• 5+ years of professional Python software engineering and backend development experience.
• Strong Python core programming and experience with Flask, FastAPI, and Django.
• Hands-on experience with REST APIs, microservices, and distributed data processing.

Responsibilities

• Design, develop, test, and maintain scalable backend applications and RESTful APIs using Python frameworks.
• Build and optimize distributed data-processing pipelines with Spark and PySpark.
• Implement robust ETL workflows and data ingestion for data lake integrations.
• Collaborate with data scientists, software architects, and cross-functional squads.

Skills

Python

Flask

FastAPI

Django

PySpark

Spark

R Programming

Docker

Kubernetes

SQLAlchemy

Django ORM

CI/CD

Git

Education

Bachelor’s degree in Computer Science or related field

Tools

Docker

Kubernetes

SQLAlchemy

Django ORM

Airflow

Job description

Position Summary

We are seeking an exceptionally skilled and experienced Python Engineer to join our technology and data engineering team on a full-time basis in the UAE. In this critical backend and data-processing role, you will be responsible for designing, building, and optimizing scalable microservices, RESTful APIs, and distributed data pipelines. The ideal candidate will bring 5+ years of professional Python engineering experience, deep technical mastery in backend frameworks (Flask, FastAPI, Django), big data processing with PySpark and Apache Spark, and mandatory proficiency in R programming. If you possess a distinguished background in building robust data-intensive applications and containerized cloud systems, we invite you to apply.

Detailed Job Description

As a Python Engineer in the UAE via IDC Technologies, you will serve as a principal technical authority responsible for developing high-performance backend applications and complex data transformation pipelines. Your daily responsibilities will encompass engineering scalable REST APIs and microservices using Flask and FastAPI, processing large-scale datasets with Apache Spark and PySpark, managing relational and NoSQL database integrations, and executing robust ETL workflows. You will also leverage R programming for advanced statistical data analysis, maintain containerized workflows with Docker and Kubernetes, and participate in automated CI/CD deployment pipelines.

Key Responsibilities

• Design, develop, test, and maintain scalable backend applications, microservices, and RESTful APIs using Core Python, Flask, and FastAPI.
• Build and optimize distributed data-processing pipelines and large-scale data transformations utilizing Apache Spark and PySpark.
• Execute advanced statistical data analysis, modeling, and data reporting utilizing R Programming.
• Design, implement, and maintain robust ETL workflows, data ingestion scripts, and data lake integrations.
• Write highly optimized database queries, schemas, and data persistence layers across SQL and NoSQL databases using SQLAlchemy and Django ORM.
• Package, containerize, and deploy application workloads using Docker and manage container orchestration via Kubernetes.
• Maintain rigorous source code version control, peer code reviews, and branching workflows using Git.
• Configure, monitor, and optimize automated CI/CD deployment pipelines for seamless software delivery.
• Collaborate proactively with data scientists, software architects, and cross-functional product squads.
• Author comprehensive technical specifications, API documentation, testing suites, and operational runbooks.

Required Qualifications & Skills

• Bachelor’s degree in Computer Science, Software Engineering, Data Engineering, Information Technology, or a related discipline.
• Minimum of 5+ years of professional software engineering and backend development experience.
• Strong core Python programming expertise and deep familiarity with backend frameworks including Flask, FastAPI, and Django.
• Proven practical experience building and optimizing REST APIs and distributed microservices architectures.
• Hands-on professional experience with big data processing frameworks such as Apache Spark and PySpark.
• Strong practical knowledge of ETL design, data transformation, and SQL/NoSQL database management (SQLAlchemy, Django ORM).
• Proficiency with containerization (Docker), container orchestration (Kubernetes), CI/CD pipelines, and Git version control.
• Mandatory technical requirement: Proven fluency and hands-on experience in R Programming.
• Mandatory residency/work authorization: Ability to operate on-site in the UAE.

Nice-to-Have Skills

• Professional certifications such as AWS Certified Developer, Certified Kubernetes Administrator (CKA), or Python Institute certifications.
• Prior professional experience within multinational technology firms or telecommunications carriers in the GCC.
• Familiarity with cloud data warehousing (Snowflake, BigQuery) and workflow orchestration (Apache Airflow).
• Immediate availability for professional mobilization in the UAE.

Compensation and Contract Details

• Salary/Rate: Competitive market rate
• Deadline: Immediate
• Notice Period: Immediate to 30 Days
• Contract Duration: Full Time / Permanent (UAE)

Recruitment Pro Tip

When applying for this Python Engineer position with IDC Technologies, ensure your resume explicitly highlights your PySpark/Spark big data experience, your Flask/FastAPI microservices portfolio, and your mandatory R programming proficiency.