AWS Data Engineer

Cognizant Technology Solutions Corporation; Chennai; Hybrid; INR 1,000,000 - 1,800,000; Full time

Job summary

Cognizant Technology Solutions Corporation is seeking a Sr. Developer with 6–9 years of experience for a hybrid role in Chennai.

The ideal candidate will design, develop, and optimize scalable data solutions using AWS Glue, Spark, Redshift, Python, and S3, ensuring high performance and reliability across cloud environments. Responsibilities include building data pipelines, storage solutions, and cross-functional collaboration to meet business goals while maintaining security and best practices.

Qualifications

• Proven AWS DevOps expertise including deployment automation and infrastructure management.
• Experience with Amazon Redshift for data warehousing and analytics.
• Advanced Python programming for scalable data solutions.
• Hands-on with AWS Glue for ETL and Apache Spark for big data processing.
• Strong understanding of Amazon S3 for secure data storage.
• Good problem-solving skills and ability to troubleshoot complex systems.
• Ability to work with cross-functional teams and stakeholders.
• Commitment to continuous learning and staying current with Cloud technologies.

Responsibilities

• Design and implement scalable data pipelines using AWS Glue and Apache Spark.
• Develop and maintain data storage with Amazon S3 and Redshift for secure, optimized management.
• Collaborate with cross-functional teams to translate requirements into technical solutions.
• Optimize workflows to improve performance and reduce overhead.
• Provide Python-based scripts and apps for data processing and automation.
• Monitor and troubleshoot AWS DevOps environments for reliable deployments.
• Perform code reviews and promote best practices for high-quality development.

Skills

AWS DevOps

Amazon Redshift

Python

AWS Glue

Apache Spark

Amazon S3

Cloud security

Team collaboration

Job description

Job Summary

We are seeking a skilled Sr. Developer with 6 to 9 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in AWS DevOps Amazon Redshift Python AWS Glue Amazon S3 and Apache Spark. This role involves designing developing and optimizing scalable solutions to meet business needs while ensuring high performance and reliability.

Responsibilities

• Design and implement scalable data pipelines using AWS Glue and Apache Spark to process large datasets efficiently.
• Develop and maintain data storage solutions leveraging Amazon S3 and Amazon Redshift to ensure secure and optimized data management.
• Collaborate with cross-functional teams to gather requirements and translate them into technical solutions that align with business objectives.
• Optimize existing workflows and processes to enhance system performance and reduce operational overhead.
• Provide technical expertise in Python programming to develop robust scripts and applications for data processing and automation.
• Monitor and troubleshoot issues in AWS DevOps environments to ensure seamless deployment and operation of applications.
• Conduct regular code reviews and implement best practices to maintain high-quality standards in development.
• Create and maintain comprehensive documentation for all development processes ensuring clarity and accessibility for team members.
• Stay updated with the latest advancements in AWS technologies and incorporate them into projects to improve efficiency and innovation.
• Ensure compliance with security standards and protocols while handling sensitive data within cloud environments.
• Collaborate with stakeholders to deliver solutions that align with organizational goals and contribute to overall business success.
• Provide mentorship and guidance to junior developers fostering a culture of continuous learning and improvement.
• Drive innovation by identifying opportunities to leverage emerging technologies for enhanced system capabilities.

Qualifications

• Possess strong expertise in AWS DevOps including deployment automation and infrastructure management.
• Demonstrate proficiency in Amazon Redshift for data warehousing and analytics solutions.
• Exhibit advanced skills in Python programming for developing scalable and efficient applications.
• Have hands-on experience with AWS Glue for ETL processes and Apache Spark for big data processing.
• Show a deep understanding of Amazon S3 for secure and optimized data storage solutions.
• Display excellent problem-solving skills and the ability to troubleshoot complex technical issues effectively.
• Possess strong communication skills to collaborate with cross-functional teams and stakeholders.
• Have a proven track record of delivering high-quality solutions within deadlines and budget constraints.
• Demonstrate a commitment to continuous learning and staying updated with industry trends and technologies.
• Exhibit a proactive approach to identifying and addressing potential risks and challenges in projects.
• Showcase the ability to work independently and take ownership of tasks while contributing to team success.
• Bring a customer-centric mindset to ensure solutions meet end-user needs and expectations.
• Possess a strong understanding of cloud security principles and best practices.

Certifications Required

AWS Certified DevOps Engineer AWS Certified Solutions Architect Apache Spark Certification