Data Engineer- PySpark

Cynosure Corporate Solutions; Chennai District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Cynosure Corporate Solutions is seeking a skilled Data Engineer to build and optimize data pipelines for the data science team. The role requires strong Python and PySpark experience, plus SQL proficiency and a solid understanding of Spark/Hadoop ecosystems.

The candidate will work on cloud platforms (Azure/AWS) and collaborate in a remote environment, breaking deliverables into actionable tasks and communicating clearly with the team.

Qualifications

• Degree in Computer Science, IT, or a similar field; a master's is a plus.
• 3-5 years of hands-on experience in Python, PySpark, and SQL.
• Great numerical and analytical skills.
• Proven expertise in building and optimizing data pipelines using Spark and Hadoop ecosystem tools.
• Experience working on cloud platforms like Azure or AWS.
• Should be able to collaborate and coordinate in a remote environment. Be a problem solver and be proactive to solve the challenges that come his way.

Responsibilities

• Build up data pipelines for consumption by the data science team.
• Clear understanding and experience with Python and PySpark.
• Experience in writing Python programs and SQL queries.
• Experience in SQL Query tuning.
• Build and maintain data pipelines in Pyspark with SQL and Python.
• Knowledge of Cloud (Azure/AWS) technologies is additional.
• Split the planned deliverables into tasks and assign them to the team.
• Good oral, written and presentation skills.

Skills

Data pipelines

Python

PySpark

SQL

Spark

Hadoop

Cloud Azure/AWS

Remote collaboration

Communication skills

Education

Bachelor in CS/IT

Master's degree

Tools

Spark

Hadoop

Azure

AWS

Job description

Cynosure Corporate Solutions | Full time

Cynosure Corporate Solutions is a human capital services company. Our focus is to provide Executive Search, Recruitment, Training, Temporary Staffing services, Statutory Compliance's, and other HR aligned services. We understand the business goals of our clients and their need to align human resources to these goals. We are committed to provide high quality manpower in accordance to global standards and their requirements. Our candidates stand testimony to our professional competency.

We work with clients in IT/ITES, Manufacturing, Automobile, Health, Telecom, Media.

Job Description

• Build up data pipelines for consumption by the data science team.
  
• Clear understanding and experience with Python and PySpark.
  
• Experience in writing Python programs and SQL queries.
  
• Experience in SQL Query tuning.
  
• Build and maintain data pipelines in Pyspark with SQL and Python.
  
• Knowledge of Cloud (Azure/AWS) technologies is additional. Suggest and implement best practices in data integration.
  
• Split the planned deliverables into tasks and assign them to the team.
  
• Good oral, written and presentation skills.
  

Requirements

• Degree in Computer Science, IT, or a similar field; a master's is a plus. Hands-on experience with Python and Pyspark
  
• 3-5 years of hands-on experience in Python, PySpark, and SQL.
  
• Great numerical and analytical skills.
  
• Proven expertise in building and optimizing data pipelines using Spark and Hadoop ecosystem tools.
  
• Experience working on cloud platforms like Azure or AWS.
  
• Should be able to collaborate and coordinate in a remote environment. Be a problem solver and be proactive to solve the challenges that come his way.