Spark_Scala Developer

Infosys; Bengaluru; Presencial; INR 1.200.000 - 1.800.000; Tempo integral

Resumo da vaga

Infosys Limited is seeking a Spark/Scala Developer with 2-5 years of experience to design and implement large-scale data processing pipelines. The role requires strong Scala skills, Spark Core/SQL/Streaming, and familiarity with Python, Hadoop, Hive, and AWS.

Collaborative, Agile environment with a focus on scalable data solutions. The candidate will contribute to Data & Analytics initiatives in Bengaluru, working on data warehousing concepts, ETL processes, and cutting-edge big data

Qualificações

• 2+ years of experience with Scala programming language.
• Experience designing and developing large-scale distributed data pipelines using Apache Spark.
• Knowledge of Spark Core, Spark SQL and Spark Streaming.
• Experience with Python, Hadoop, HDFS, Hive and other Big Data technologies.
• Familiarity with data warehousing and ETL concepts.

Responsabilidades

• Develop and maintain Scala-based data processing pipelines.
• Build and optimize Spark jobs for large-scale data processing.
• Collaborate with cross-functional teams to translate requirements into technical designs.
• Work in an Agile environment and participate in daily standups and sprint planning.
• Ensure code quality, performance, and reliability of data processing solutions.

Conhecimentos

Scala

Apache Spark

Spark SQL

Spark Streaming

Python

Hadoop

Hive

AWS

SQL/NoSQL

Unix Shell

Formação

B.E./B.Tech

Bachelor of Engineering

Descrição da vaga

Job ID/Reference Code INFSYS-EXTERNAL-255010

Work Experience 2 - 5 Years

Job Title Spark_Scala Developer

Educational Requirements

Bachelor of Engineering,Bachelor Of Technology

Service Line

Data & Analytics Unit

Responsibilities

• At least 2+ years of experience and strong knowledge in Scala programming language.
• Able to write clean, maintainable and efficient Scala code following best practices.
• Good knowledge on the fundamental Data Structures and their usage
• At least 5+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.
• Having expertise in Spark Core, Spark SQL and Spark Streaming.
• Experience with Python, Hadoop, HDFS, Hive and other BigData technologies.
• Familiarity with Data warehousing and ETL concepts and techniques
• Working Knowledge in AWS (Glue EMR) etc. is good to have.
• Having expertise in Database concepts and SQL/NoSQL operations.
• UNIX shell scripting will be an added advantage in scheduling/running application jobs.
• At least 2+ years of experience in Project development life cycle activities and maintenance/support projects.
• Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives.
• Understand project requirements and translate them into technical solutions which meets the project quality standards
• Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues.
• Strong problem solving and Good Analytical skills.
• Excellent verbal and written communication skills.
• Experience and desire to work in a Global delivery environment.
• Stay up to date with new technologies and industry trends in Development.

Preferred Skills:

Technology->Java->Apache->Spark Technology->Data Engineering->Spark->SparkSQL