AWS Data Engineer

Cognizant Technology Solutions Corporation; Chennai; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Cognizant in Chennai is seeking a Senior Developer with 6–9 years of experience to join our team in a hybrid work model. You will design, develop, and optimize scalable data solutions using AWS Glue, Apache Spark, Redshift, and S3, with Python-driven automation and robust DevOps practices.

The role emphasizes delivering high-performant data pipelines, secure storage, and reliable deployments while collaborating with cross-functional teams.

Qualifications

• Strong expertise in AWS DevOps including deployment automation and infrastructure management.
• Proficiency with Amazon Redshift for data warehousing and analytics.
• Advanced Python programming for scalable data processing applications.
• Hands-on experience with AWS Glue for ETL and Apache Spark for big data processing.
• Deep knowledge of Amazon S3 secure data storage and access patterns.
• Excellent problem solving and cross-functional collaboration skills.
• Commitment to continuous learning and staying updated with cloud technologies.

Responsibilities

• Design and implement scalable data pipelines using AWS Glue and Apache Spark.
• Develop and maintain data storage solutions leveraging Amazon S3 and Amazon Redshift.
• Collaborate with cross-functional teams to translate requirements into technical solutions.
• Optimize workflows to improve performance and reduce operational overhead.
• Provide Python-based scripts and applications for data processing and automation.
• Monitor and troubleshoot AWS DevOps deployments to ensure reliable operations.
• Review code and enforce best practices to maintain high-quality standards.
• Create and maintain comprehensive development documentation.
• Stay updated with AWS advancements and apply them to projects.
• Ensure security standards and data protection within cloud environments.
• Collaborate with stakeholders to align solutions with business goals.
• Mentor junior developers and promote continuous learning.
• Drive innovation by leveraging emerging technologies for system enhancements.

Skills

AWS DevOps

Amazon Redshift

Python

AWS Glue

Apache Spark

Amazon S3

Job description

Job Summary

We are seeking a skilled Sr. Developer with 6 to 9 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in AWS DevOps Amazon Redshift Python AWS Glue Amazon S3 and Apache Spark. This role involves designing developing and optimizing scalable solutions to meet business needs while ensuring high performance and reliability.

Responsibilities

• Design and implement scalable data pipelines using AWS Glue and Apache Spark to process large datasets efficiently.
• Develop and maintain data storage solutions leveraging Amazon S3 and Amazon Redshift to ensure secure and optimized data management.
• Collaborate with cross-functional teams to gather requirements and translate them into technical solutions that align with business objectives.
• Optimize existing workflows and processes to enhance system performance and reduce operational overhead.
• Provide technical expertise in Python programming to develop robust scripts and applications for data processing and automation.
• Monitor and troubleshoot issues in AWS DevOps environments to ensure seamless deployment and operation of applications.
• Conduct regular code reviews and implement best practices to maintain high-quality standards in development.
• Create and maintain comprehensive documentation for all development processes ensuring clarity and accessibility for team members.
• Stay updated with the latest advancements in AWS technologies and incorporate them into projects to improve efficiency and innovation.
• Ensure compliance with security standards and protocols while handling sensitive data within cloud environments.
• Collaborate with stakeholders to deliver solutions that align with organizational goals and contribute to overall business success.
• Provide mentorship and guidance to junior developers fostering a culture of continuous learning and improvement.
• Drive innovation by identifying opportunities to leverage emerging technologies for enhanced system capabilities.

Qualifications

• Possess strong expertise in AWS DevOps including deployment automation and infrastructure management.
• Demonstrate proficiency in Amazon Redshift for data warehousing and analytics solutions.
• Exhibit advanced skills in Python programming for developing scalable and efficient applications.
• Have hands-on experience with AWS Glue for ETL processes and Apache Spark for big data processing.
• Show a deep understanding of Amazon S3 for secure and optimized data storage solutions.
• Display excellent problem-solving skills and the ability to troubleshoot complex technical issues effectively.
• Possess strong communication skills to collaborate with cross-functional teams and stakeholders.
• Have a proven track record of delivering high-quality solutions within deadlines and budget constraints.
• Demonstrate a commitment to continuous learning and staying updated with industry trends and technologies.
• Exhibit a proactive approach to identifying and addressing potential risks and challenges in projects.
• Showcase the ability to work independently and take ownership of tasks while contributing to team success.
• Bring a customer-centric mindset to ensure solutions meet end-user needs and expectations.
• Possess a strong understanding of cloud security principles and best practices.

Certifications Required

AWS Certified DevOps Engineer AWS Certified Solutions Architect Apache Spark Certification