PySpark Data Engineer - Big Data ETL & Analytics

Acesoft Labs (India) Pvt Ltd

Dubai

Híbrido

AED 35.000 - 50.000

Jornada completa

14 días+

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

Acesoft Labs (India) Pvt Ltd in Bangalore is seeking a skilled PySpark Developer with hands-on experience in big data processing, data engineering, and distributed computing. You will develop, optimize, and maintain scalable data pipelines using PySpark, Python, and related technologies.

The role requires building ETL pipelines, tuning performance, and working with cloud-based data platforms. You will collaborate with data engineers, architects, and analysts to ensure data quality and timely

Formación

  • Hands-on PySpark development experience.
  • Strong Python programming skills.
  • Good knowledge of Spark DataFrames, Spark SQL, RDDs, and transformations.
  • Experience building ETL/ELT pipelines.
  • SQL skills with relational databases.
  • Familiarity with data warehousing concepts and large datasets.

Responsabilidades

  • Develop and maintain scalable ETL/ELT data pipelines using PySpark and Python.
  • Design data processing solutions for large and complex datasets.
  • Write optimized Spark transformations and manage DataFrames/Spark SQL.
  • Perform data cleansing, validation, transformation and aggregation.
  • Tune Spark jobs for performance and resource utilization.
  • Work with structured and semi-structured data from multiple sources.

Conocimientos

PySpark
Python
Big Data
ETL
SQL
Spark Architecture
Data Warehousing
Delta Lake
Airflow
CI/CD

Educación

Bachelor's or Master's in CS/IT/Engineering

Herramientas

Databricks
Cloud platforms (AWS/Azure/GCP)

Descripción del empleo

Acesoft Labs (India) Pvt Ltd in Bangalore is seeking a skilled PySpark Developer with hands-on experience in big data processing, data engineering, and distributed computing. You will develop, optimize, and maintain scalable data pipelines using PySpark, Python, and related technologies.

The role requires building ETL pipelines, tuning performance, and working with cloud-based data platforms. You will collaborate with data engineers, architects, and analysts to ensure data quality and timely

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Hybrid Data Engineer - PySpark, Databricks & Cloud
Hybrid Data Engineer - PySpark, Databricks & Cloud

Acesoft Labs (India) Pvt Ltd • Dubai

Híbrido
AED 200.000 - 350.000
Pyspark Developer
Pyspark Developer

Acesoft Labs (India) Pvt Ltd • Dubai

Híbrido
AED 35.000 - 50.000
Senior Technical Lead
Senior Technical Lead

HCL Technologies Limited • Dubai

Presencial
AED 167.000 - 279.000
Data Engineer (PySpark)
Data Engineer (PySpark)

Black Pearl Consult • Abu Dhabi

Presencial
AED 260.000 - 380.000
Senior PySpark Tech Lead – ETL & Data Lakes
Senior PySpark Tech Lead – ETL & Data Lakes

HCL Technologies Limited • Dubai

Presencial
AED 167.000 - 279.000
Dubai-based PySpark Data Engineer | CDP & ETL Expert
Dubai-based PySpark Data Engineer | CDP & ETL Expert

HireAlpha • Dubai

Presencial
AED 320.000 - 520.000
Data Engineer
Data Engineer

Acesoft Labs (India) Pvt Ltd • Dubai

Híbrido
AED 200.000 - 350.000
PySpark Data Engineer - Remote/Virtual
PySpark Data Engineer - Remote/Virtual

HCL Technologies Limited • Dubai

Presencial
AED 180.000 - 280.000
Data Engineer
Data Engineer

HCL Technologies Limited • Dubai

Presencial
AED 180.000 - 280.000
Data Engineer: Python, Spark and ETL for Dubai Contract
Data Engineer: Python, Spark and ETL for Dubai Contract

edari • Dubai

Presencial
AED 180.000 - 320.000
Ubicaciones