AWS Data Engineer

NorthBay Solutions

Dubai

À distance

AED 47 000 - 79 000

Plein temps

Il y a 7 jours
Soyez parmi les premiers à postuler

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

NorthBay Solutions is seeking an experienced AWS Data Engineer to build and support cloud-based data pipelines and analytics platforms on AWS. The role emphasizes hands-on development, optimization, and operational support of data processing systems.

Key responsibilities include designing scalable batch pipelines, ETL/ELT jobs, and serverless data processing, leveraging services like AWS Glue, EMR, Lambda, and Airflow, with Redshift and DynamoDB for warehousing and data access governance.

Qualifications

  • 58 years of experience in data engineering or related roles.
  • Proficient in SQL and Python.
  • Experience with batch data processing and data pipeline development.
  • Understanding of data warehousing and ETL concepts.
  • Experience working in Agile delivery environments.

Responsabilités

  • Develop and maintain scalable batch data pipelines on AWS.
  • Implement ETL/ELT jobs using AWS Glue and Spark on EMR.
  • Build and manage workflow orchestration using Apache Airflow (MWAA).
  • Develop serverless data processing functions using AWS Lambda.
  • Work with Amazon Redshift for data warehousing and analytics.
  • Implement data storage and retrieval using Amazon DynamoDB.
  • Use AWS DataZone for data discovery governance and access control.
  • Monitor data pipelines and system health using Amazon CloudWatch.
  • Troubleshoot data processing failures and performance issues.
  • Collaborate with analytics reporting and business teams.
  • Follow best practices for security scalability and cost optimization.

Connaissances

SQL
Python
Batch processing
ETL/ELT
Agile

Outils

AWS Glue
Amazon EMR
AWS Lambda
Apache Airflow (MWAA)
Amazon EC2
Amazon CloudWatch
Amazon Redshift
Amazon DynamoDB
AWS DataZone

Description du poste

Job Title: AWS Data Engineer

Experience: 58 Years
Location: India (Remote)
Employment Type: Full-Time

Position Overview

We are looking for a skilled AWS Data Engineer to build and support cloud-based data pipelines and analytics platforms on AWS. The role focuses on hands-on development optimization and operational support of data processing systems.

Key Responsibilities

  • Develop and maintain scalable batch data pipelines on AWS
  • Implement ETL/ELT jobs using AWS Glue and Spark on EMR
  • Build and manage workflow orchestration using Apache Airflow (MWAA)
  • Develop serverless data processing functions using AWS Lambda
  • Work with Amazon Redshift for data warehousing and analytics
  • Implement data storage and retrieval using Amazon DynamoDB
  • Use AWS DataZone for data discovery governance and access control
  • Monitor data pipelines and system health using Amazon CloudWatch
  • Troubleshoot data processing failures and performance issues
  • Collaborate with analytics reporting and business teams
  • Follow best practices for security scalability and cost optimization

Required Skills & Experience

  • 58 years of experience in data engineering or related roles
  • Hands-on experience with:
    • AWS Glue
    • Amazon EMR
    • AWS Lambda
    • Apache Airflow (MWAA)
    • Amazon EC2
    • Amazon CloudWatch
    • Amazon Redshift
    • Amazon DynamoDB
    • AWS DataZone
  • Strong SQL and Python skills
  • Experience with batch data processing and data pipeline development
  • Understanding of data warehousing and ETL concepts
  • Experience working in Agile delivery environments

Nice to Have

  • AWS Certification
  • Exposure to data governance and metadata tools
  • Experience with performance tuning and cost optimization on AWS

Required Experience:

Manager

Key Skills
Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Department / Functional Area: Data Engineering
Experience: years
Vacancy: 1

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

AWS Data Engineer
AWS Data Engineer

Salt • Abu Dhabi

Sur place
AED 480 000 - 720 000
Senior AWS Data Engineer (Remote, India)
Senior AWS Data Engineer (Remote, India)

NorthBay Solutions • Dubai

À distance
AED 47 000 - 79 000
Data Platform Engineer
Data Platform Engineer

Dicetek LLC • Abu Dhabi

Sur place
AED 280 000 - 420 000
Data Engineering Lead
Data Engineering Lead

Impelsys • Dubai

Sur place
AED 350 000 - 550 000
Data Engineer
Data Engineer

VENQUIS LIMITED • Abu Dhabi

Sur place
AED 240 000 - 480 000
Data Engineer
Data Engineer

VaporVM • Dubai

Sur place
AED 300 000 - 520 000
Data Engineer
Data Engineer

Talent Bridge HR Consultancy Dubai • Dubai

Sur place
AED 120 000 - 180 000
DB Developer
DB Developer

IBS Software • Abu Dhabi

Sur place
AED 246 000 - 379 000
Data Engineer
Data Engineer

CNTXT, Inc. • Abu Dhabi

Sur place
AED 240 000 - 420 000
Sr Data Engineer, 3866
Sr Data Engineer, 3866

Mindtel • Dubai

Sur place
AED 446 000 - 670 000
Lieux principaux