Data Engineer- PySpark

Cynosure Corporate Solutions; Chennai; On-site; INR 700,000 - 1,200,000; Full time

Job summary

A leading IT consulting firm in Chennai is seeking a Data Engineer with strong skills in Python and PySpark. Your role will be to build and maintain data pipelines while communicating effectively with team members. The ideal candidate should have 3-5 years of experience and a degree in Computer Science or IT. This is a full-time position offering opportunities to work with cloud technologies.

Qualifications

• 3-5 years of hands-on experience in Python, PySpark, and SQL.
• Proven expertise in building and optimizing data pipelines.
• Experience working on cloud platforms like Azure or AWS.

Responsibilities

• Build and maintain data pipelines in PySpark with SQL and Python.
• Communicate effectively with team members.
• Suggest and implement best practices in data integration.

Skills

Python

PySpark

SQL

Cloud Technologies (Azure/AWS)

Education

Degree in Computer Science, IT, or related field

Job description

Overview

Join to apply for the Data Engineer- PySpark role at Cynosure Corporate Solutions.

Responsibilities

• Build up data pipelines for consumption by the data science team.
• Build and maintain data pipelines in PySpark with SQL and Python.
• Clear understanding and experience with Python and PySpark.
• Experience in writing Python programs and SQL queries.
• Experience in SQL query tuning.
• Knowledge of Cloud (Azure/AWS) technologies is a plus. Suggest and implement best practices in data integration.
• Split the planned deliverables into tasks and assign them to the team.
• Communicate effectively with team members; strong oral, written and presentation skills.

Qualifications

• Degree in Computer Science, IT, or a similar field; a master's is a plus. Hands-on experience with Python and PySpark.
• 3-5 years of hands-on experience in Python, PySpark, and SQL.
• Great numerical and analytical skills.
• Proven expertise in building and optimizing data pipelines using Spark and Hadoop ecosystem tools.
• Experience working on cloud platforms like Azure or AWS.
• Ability to collaborate in a remote environment; problem solver and proactive in addressing challenges.

Seniority level

• Executive

Employment type

• Full-time

Job function

• Business Development

Industries

• IT Services and IT Consulting

Get notified about new Data Engineer jobs in Chennai, Tamil Nadu, India.