Big Data Engineer

Evoke HR; Chennai District, Bengaluru; Hybrid; INR 1,100,000 - 1,500,000; Full time

Job summary

Evoke HR is seeking a Big Data Engineer in Chennai with 4+ years of hands-on experience in PySpark, Python, SQL, Spark, Hive and Unix. You will develop and maintain scalable Big Data pipelines using PySpark and Spark; perform data processing, transformation and validation with Python and SQL; and work with Hive for querying and processing.

You will also execute and troubleshoot data jobs in Unix/Linux environments, optimize pipelines and collaborate with cross‑functional teams to deliver

Qualifications

• 4+ years of hands-on experience in Big Data engineering.
• Proficient in PySpark, Python, SQL, Spark, Hive and Unix/Linux.
• Experience building scalable data pipelines and data processing workflows.
• Strong problem-solving and communication skills.

Responsibilities

• Develop and maintain scalable Big Data pipelines using PySpark and Spark.
• Perform data processing, transformation and validation using Python and SQL.
• Work with Hive for data querying and processing.
• Execute and troubleshoot data jobs in Unix/Linux environments.
• Optimize data pipelines and resolve performance and production issues.
• Collaborate with cross-functional teams to deliver reliable data solutions.

Skills

PySpark

Spark

Python

SQL

Hive

Unix/Linux

ETL/ELT

Data Engineering

Job description

We are looking for a Big Data Engineer with 4+ years of experience and strong hands‑on expertise in PySpark, Python, SQL, Spark, Hive, and Unix.

Key Responsibilities

• Develop and maintain scalable Big Data pipelines using PySpark and Spark.
• Perform data processing, transformation, and validation using Python and SQL.
• Work with Hive for data querying and processing.
• Execute and troubleshoot data jobs in Unix/Linux environments.
• Optimize data pipelines and resolve performance and production issues.
• Collaborate with cross‑functional teams to deliver reliable data solutions.

Required Skills

• Strong hands‑on experience with PySpark, Spark, Python, and SQL.
• Good knowledge of Hive and Unix/Linux.
• Strong understanding of ETL/ELT and data processing.
• Good problem‑solving and communication skills.

Key Skills: Big Data | PySpark | Spark | Python | SQL | Hive | Unix/Linux | ETL | Data Engineering