Senior AWS Data Engineer - Build Scalable Data Pipelines

NorthBay, LLC; Dubai; On-site; AED 120,000 - 160,000; Full time

Job summary

A leading data solutions firm is seeking a highly experienced Senior AWS Data Engineer to design, build, and optimize large-scale data platforms on AWS. The ideal candidate will have over 8 years of experience with AWS data services and will play a key role in architecting enterprise-grade data solutions. Responsibilities include leading the implementation of data processing solutions and collaborating with various teams to ensure data governance. This is a full-time onsite position in Dubai.

Qualifications

• 8+ years of experience in data engineering and data platform development.
• Strong hands-on experience with AWS data services.
• Proficiency in SQL, Python, and Spark.

Responsibilities

• Design, develop, and optimize scalable data pipelines using AWS native services.
• Lead the implementation of batch and near-real-time data processing solutions.
• Orchestrate complex data workflows using Apache Airflow (MWAA).
• Monitor, log, and troubleshoot data pipelines using Amazon CloudWatch.

Skills

AWS Glue

Amazon EMR (Spark)

AWS Lambda

Apache Airflow (MWAA)

Amazon EC2

Amazon CloudWatch

Amazon Redshift

Amazon DynamoDB

AWS DataZone

SQL

Python

Spark

Job description

A leading data solutions firm is seeking a highly experienced Senior AWS Data Engineer to design, build, and optimize large-scale data platforms on AWS. The ideal candidate will have over 8 years of experience with AWS data services and will play a key role in architecting enterprise-grade data solutions. Responsibilities include leading the implementation of data processing solutions and collaborating with various teams to ensure data governance. This is a full-time onsite position in Dubai.