Spark Scala+ AWS & SQL Developer

Job Description

We are looking for a skilled and experienced Spark Scala Developer with strong expertise in AWS cloud services and SQL to join our data engineering team. The ideal candidate will be responsible for designing, building, and optimizing scalable data processing systems that support our data platform.

Key Responsibilities:

1. Develop and maintain large-scale distributed data processing pipelines using Apache Spark with Scala.
2. Work with AWS services (S3, EMR, Lambda, Glue, Redshift, etc.) to build and manage data solutions in the cloud.
3. Write complex SQL queries for data extraction, transformation, and analysis.
4. Optimize Spark jobs for performance and cost-efficiency.
5. Collaborate with data scientists, analysts, and other developers to understand data requirements.
6. Build and maintain data lake and data warehouse solutions.
7. Implement best practices in coding, testing, and deployment.
8. Ensure data quality and consistency across systems.

Required Skills and Experience:

• Strong hands-on experience with Apache Spark (preferably using Scala).
• Proficiency in Scala programming language.
• Solid experience with SQL (complex joins, window functions, performance tuning).
• Working knowledge of AWS services like S3, EMR, Glue, Lambda, Athena, Redshift.
• Experience in building and maintaining ETL/ELT pipelines.
• Familiarity with data modeling and data warehousing concepts.
• Experience with version control (e.g., Git) and CI/CD pipelines is a plus.
• Strong problem-solving and communication skills.

Employment Details:

Employment Type: Full time

Industry: IT Services & Consulting

Role Category: Not Specified

Functional Area: Not Specified

Role/Responsibilities: Spark Scala + AWS & SQL Developer

Contact Details:

Company: Cognizant

Location: Karnataka

Ability to work in a team environment with members of varying skill levels. Highly motivated. Learns quickly.