Pyspark Data Engineer

Synechron Technologies Pvt. Ltd._INDIA Company; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Synechron is seeking a Data Engineer in Chennai to design, develop, and maintain scalable data pipelines using PySpark and CDP. You will work with big data tech, cloud-native environments, and distributed processing to deliver reliable data solutions.

The role requires hands-on experience with Hadoop, Hive, HDFS, Spark, and ETL processes, along with a strong understanding of data warehousing and big data architecture. 5+ years of experience preferred.

Qualifications

• Strong PySpark and CDP experience.
• Hands-on Hadoop/Hive/HDFS/Spark and ETL capabilities.
• Solid understanding of data warehousing and big data architectures.

Responsibilities

• Design scalable data pipelines using PySpark and CDP.
• Optimize and maintain data ingestion and transformation processes.
• Ensure data quality, integrity, and availability across platforms.

Skills

PySpark

CDP

Hadoop

Hive

HDFS

Spark

ETL

Data Warehousing

Cloud

Big Data

Job description

Job Title: Data Engineer Location: Chennai

Job Description: We are looking for a skilled Data Engineer with strong expertise in PySpark and Cloudera Data Platform (CDP) to design, develop, and maintain scalable data pipelines. The ideal candidate will have experience working with big data technologies, cloud-native environments, and data processing frameworks to ensure high-quality and reliable data solutions.

Key Responsibilities:

• Design and develop scalable data pipelines using PySpark and CDP.
• Build, optimize, and maintain data ingestion and transformation processes.
• Ensure data quality, integrity, and availability across platforms.
• Work with large-scale datasets and big data ecosystems.
• Collaborate with cross-functional teams to deliver data-driven solutions.
• Monitor and troubleshoot data workflows and performance issues.

Required Skills:

• Strong experience in PySpark and Cloudera Data Platform (CDP).
• Hands-on experience with Hadoop, Hive, HDFS, Spark, and ETL processes.
• Good understanding of data warehousing and big data architecture.
• Experience with cloud and distributed data processing environments.
• Strong problem-solving and analytical skills.

Experience:

• 5+ Years (preferred)

SYNECHRON'S DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative 'Same Difference' is committed to fostering an inclusive culture - promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more. All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant's gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,500+, and has 58 offices in 21 countries within key global markets. For more information on the company, please visit our website or LinkedIn community. At Synechron, we are committed to integrating sustainability into our business strategy, ensuring responsible growth while minimizing environmental impact. Employees play a key role in driving our sustainability initiatives, from reducing our carbon footprint to fostering ethical and sustainable business practices across global operations. All positions are required to adhere to our Sustainability and Health Safety standards, demonstrating a commitment to environmental stewardship, workplace safety, and sustainable practices.