Python, Pyspark, SQL

Cognizant; Hyderabad; Hybrid; INR 1,000,000 - 1,600,000; Full time

Job summary

Cognizant in India is seeking a data engineer to design, develop, and maintain scalable data pipelines and ETL processes across Bangalore and Hyderabad.

You will develop and optimize data processing solutions using Python and PySpark, write advanced SQL queries, and work with large datasets in distributed computing environments. The role requires collaboration with architects, analysts, and stakeholders to deliver data-driven solutions.

Qualifications

• 5–13 years of experience in Data Engineering or related roles.
• Strong hands-on experience in Python development.
• Proven experience with PySpark for large-scale data processing.
• Strong knowledge of SQL, including query optimization and performance tuning.
• Exposure to or working knowledge of Scala.
• Experience working with cloud-based or enterprise data platforms.
• Strong analytical, problem-solving, and communication skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes.
• Develop and optimize data processing solutions using Python and PySpark.
• Write complex and high-performing SQL queries for data extraction, transformation, and analysis.
• Work with large datasets and distributed computing frameworks to support data engineering initiatives.
• Collaborate with architects, analysts, and business stakeholders to deliver data-driven solutions.
• Troubleshoot and resolve performance, scalability, and data quality issues.
• Contribute to data platform modernization and best practices.

Skills

Python

PySpark

SQL

Scala

Cloud platforms

Job description

Experience: 5 to 13 years

Location: Bangalore & Hyderabad

Primary Skills: Python, Pyspark, SQL

Job Description

• Design, develop, and maintain scalable data pipelines and ETL processes.
• Develop and optimize data processing solutions using Python and PySpark.
• Write complex and high-performing SQL queries for data extraction, transformation, and analysis.
• Work with large datasets and distributed computing frameworks to support data engineering initiatives.
• Collaborate with architects, analysts, and business stakeholders to deliver data-driven solutions.
• Troubleshoot and resolve performance, scalability, and data quality issues.
• Contribute to data platform modernization and best practices.

Skills

• 5–13 years of experience in Data Engineering or related roles.
• Strong hands-on experience in Python development.
• Proven experience with PySpark for large-scale data processing.
• Strong knowledge of SQL, including query optimization and performance tuning.
• Exposure to or working knowledge of Scala.
• Experience working with cloud-based or enterprise data platforms.
• Strong analytical, problem-solving, and communication skills.

Preferred Skills

• Experience with data warehousing and ETL frameworks.
• Exposure to cloud platforms such as Azure, AWS, or GCP.