PySpark Data Engineer

Synechron; Chennai District; On-site; INR 800,000 - 1,200,000; Full time

Job summary

Synechron in Chennai is seeking a Data Engineer to design, develop, and maintain scalable data pipelines using PySpark and Cloudera Data Platform (CDP). The role focuses on building reliable data solutions in cloud-native environments and collaborating with cross-functional teams.

The ideal candidate has hands-on experience with Hadoop, Hive, HDFS, Spark, and ETL processes, plus 5+ years of data engineering experience, and strong problem-solving skills.

Qualifications

• 5+ years of data engineering experience.
• Proficiency in PySpark and Cloudera Data Platform (CDP).
• Hands-on with Hadoop, Hive, HDFS, and Spark.
• Experience with cloud environments and ETL workflows.
• Strong analytical and problem-solving skills.

Responsibilities

• Design scalable data pipelines using PySpark and CDP.
• Build and optimize data ingestion and transformation processes.
• Ensure data quality, integrity, and availability across platforms.
• Work with large-scale datasets and big data ecosystems.
• Collaborate with cross-functional teams to deliver data-driven solutions.
• Monitor and troubleshoot data workflows and performance issues.

Skills

PySpark

CDP

Hadoop

Hive

HDFS

Spark

ETL

Job description

Job Title: Data Engineer

Location: Chennai

Job Description

We are looking for a skilled Data Engineer with strong expertise in PySpark and Cloudera Data Platform (CDP) to design, develop, and maintain scalable data pipelines. The ideal candidate will have experience working with big data technologies, cloud-native environments, and data processing frameworks to ensure high-quality and reliable data solutions.

Key Responsibilities

• Design and develop scalable data pipelines using PySpark and CDP.
• Build, optimize, and maintain data ingestion and transformation processes.
• Ensure data quality, integrity, and availability across platforms.
• Work with large-scale datasets and big data ecosystems.
• Collaborate with cross-functional teams to deliver data-driven solutions.
• Monitor and troubleshoot data workflows and performance issues.

Required Skills

• Strong experience in PySpark and Cloudera Data Platform (CDP).
• Hands-on experience with Hadoop, Hive, HDFS, Spark, and ETL processes.
• Good understanding of data warehousing and big data architecture.
• Experience with cloud and distributed data processing environments.
• Strong problem-solving and analytical skills.

Experience: 5+ Years (preferred)
Location: Chennai

Synechron’s Diversity & Inclusion Statement

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.