Big Data Developer - PySpark, Hadoop, Cloudera & SQL

Advance Career Solutions; Thane; Hybrid; INR 1,200,000 - 2,500,000; Full time

Job summary

Advance Career Solutions in Thane is seeking a seasoned Big Data Developer to design and maintain data pipelines using PySpark, Hadoop, Cloudera and SQL. The role requires 4 to 11 years of hands-on experience and a strong command of data processing technologies.

You will collaborate with data teams to ensure data quality and performance, implement ETL solutions, and optimize queries across large datasets in an on-site setup in Thane.

Qualifications

• 4+ years of hands-on experience with PySpark, Hadoop, and Cloudera.
• Strong SQL skills for data extraction, transformation, and loading.
• Experience building and optimizing data pipelines and ETL processes.

Responsibilities

• Develop and maintain data pipelines using PySpark.
• Work with Hadoop and Cloudera platforms.
• Write and optimize SQL queries for data processing.
• Perform data transformation and ETL operations.
• Troubleshoot data pipeline issues and improve performance.
• Collaborate with data engineering and analytics teams.

Skills

PySpark

Hadoop

Cloudera

SQL

Big Data & ETL

Tools

Apache Hive

Apache Spark

HDFS

Python

Linux/Unix

Job description

Job Title: Big Data Developer PySpark, Hadoop, Cloudera & SQL

Location: Thane Experience: 4 to 11 Years

Job Description:

We are looking for an experienced Big Data Developer with strong knowledge of PySpark, Hadoop, Cloudera, and SQL to develop and maintain data processing solutions.

Key Responsibilities:

• Develop and maintain data pipelines using PySpark.
• Work with Hadoop and Cloudera platforms.
• Write and optimize SQL queries for data processing.
• Perform data transformation and ETL operations.
• Troubleshoot data pipeline issues and improve performance.
• Ensure data quality, accuracy, and consistency.
• Collaborate with data engineering and analytics teams.

Mandatory Skills:

• PySpark
• Hadoop
• Cloudera
• SQL
• Big Data and ETL

Good-to-Have Skills:

• Apache Hive
• Apache Spark
• HDFS
• Python
• Linux/Unix