Senior AWS Data Engineer

NorthBay; Dubai; On-site; AED 200,000 - 280,000; Full time

Job summary

A technology company in Dubai is seeking a skilled Senior AWS Data Engineer to design and optimize large-scale data platforms using AWS services. The ideal candidate will have over 8 years of experience and expertise in data processing frameworks including AWS Glue and Apache Spark as well as proficiency in SQL and Python. This full-time position demands collaboration with architects and stakeholders, ensuring data quality and security while developing scalable solutions.

Qualifications

• 8+ years of experience in data engineering and data platform development.
• Strong hands-on experience with various AWS services.
• Proficiency in SQL, Python, and Spark.

Responsibilities

• Design, develop, and optimize scalable data pipelines using AWS native services.
• Lead the implementation of batch and near-real-time data processing solutions.
• Collaborate with architects, analytics teams, and business stakeholders.

Skills

AWS Glue

Amazon EMR (Spark)

AWS Lambda

Apache Airflow (MWAA)

SQL

Python

Spark

Amazon Redshift

Amazon DynamoDB

AWS DataZone

Job description

Overview

Job Title: Senior AWS Data Engineer / Data Platform Engineer

Experience: 8+ Years
Location: Dubai, UAE (Onsite)
Employment Type: Full-Time

Position Overview

We are seeking a highly experienced Senior AWS Data Engineer to design, build, and optimize large-scale data platforms on AWS. The ideal candidate will have deep hands-on experience with AWS data services, batch and streaming data processing, and orchestration frameworks, playing a key role in architecting and maintaining enterprise-grade data solutions.

Key Responsibilities

• Design, develop, and optimize scalable data pipelines using AWS native services
• Lead the implementation of batch and near-real-time data processing solutions
• Architect and manage data ingestion, transformation, and storage layers
• Build and maintain ETL/ELT workflows using AWS Glue and Apache Spark on EMR
• Orchestrate complex data workflows using Apache Airflow (MWAA)
• Develop and manage serverless data processing using AWS Lambda
• Design and optimize data warehouses using Amazon Redshift
• Implement and manage NoSQL data models using Amazon DynamoDB
• Utilize AWS DataZone for data governance, cataloging, and access management
• Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch
• Ensure data security, quality, performance, and cost optimization
• Collaborate with architects, analytics teams, and business stakeholders
• Provide technical guidance and mentorship to junior team members

Required Skills & Experience

• 8+ years of experience in data engineering and data platform development
• Strong hands-on experience with: AWS Glue, Amazon EMR (Spark), AWS Lambda, Apache Airflow (MWAA), Amazon EC2, Amazon CloudWatch, Amazon Redshift, Amazon DynamoDB, AWS DataZone
• Strong experience with batch data processing architectures
• Proficiency in SQL, Python, and Spark
• Experience working with large-scale datasets and distributed systems
• Strong understanding of data modeling, data warehousing, and ETL patterns
• Experience with CI/CD pipelines and Infrastructure as Code is a plus

Nice to Have

• AWS Certification (Data Analytics / Solutions Architect)
• Experience with data governance and metadata management
• Exposure to data lake and lakehouse architectures