Spark Developer

Infosys; Bengaluru; Presencial; INR 1.200.000 - 2.400.000; Tempo integral

Resumo da vaga

Infosys Bengaluru seeks an experienced Data Engineer to join our Data Analytics Unit. You will design and deliver robust Java/Spark data processing solutions, build scalable pipelines, and collaborate with global client teams to ensure quality and timely delivery.

Proficiency with Spark Core/SQL, Kafka, Hadoop/HDFS, ETL concepts, and cloud tools is essential. Excellent communication and problem-solving skills, and ability to work in an Agile global delivery environment are required.

Qualificações

• Minimum 2+ years of experience with Java and related frameworks.
• 6+ years designing large-scale data pipelines with Apache Spark.
• Strong Java core, JVM, memory management knowledge.
• Experience with Kafka messaging and real-time streaming.
• Experience with Hadoop/HDFS and Hive.
• Knowledge of AWS EMR/GluE and data warehousing/ETL concepts.
• Proficient in SQL/NoSQL databases.
• Unix shell scripting advantageous.
• Experience in Agile development and Scrum ceremonies.
• Excellent communication and collaboration in a global delivery setup.

Responsabilidades

• Interface with client for QA and issue resolution.
• Understand requirements, review designs, validate architecture.
• Contribute to solution delivery and project estimation.
• Perform code reviews and unit test plan reviews.
• Lead teams towards high-quality code and knowledge management.
• Contribute to building efficient data programs and systems.
• Stay updated with new technologies and industry trends.

Conhecimentos

Java

Spark

Data pipelines

Kafka

Hadoop

SQL/NoSQL

Shell scripting

Agile / Scrum

Problem solving

Communication

Formação

Bachelor of Engineering

Bachelor Of Technology

Ferramentas

Spark Core

Spark SQL

Hive

AWS EMR

HDFS

NoSQL databases

Kafka

Descrição da vaga

Job Description

A day in the life of an Infoscion

• As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction.
• You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain.
• You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews.
• You will lead and guide your teams towards developing optimized high quality code deliverables, continual knowledge management and adherence to the organizational guidelines and processes.
• You would be a key contributor to building efficient programs/ systems and if you think you fit right in to help our clients navigate their next in their digital transformation journey, this is the place for you! If you think you fit right in to help our clients navigate their next in their digital transformation journey, this is the place for you!

Roles Responsibilities

• Minimum 2+ years of experience and strong knowledge in Java and related frameworks.
• Expertise in building robust, scalable and maintainable applications with Java and Spark.
• Able to write clean, maintainable and efficient Java code following best practices.
• Having deep understanding of Java core and Java EE concepts, JVM internals such as class loading and memory management.
• Good knowledge on the fundamental Data Structures, Collections and their usage
• At least 6+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies.
• Having expertise in Spark Core, Spark SQL, Batch processing and Spark Streaming with Spark Java API.
• Expertise in Kafka messaging, producer, consumer operations and offset management for real-time data streaming with Apache Kafka/Confluent Kafka.
• Experience with Hadoop, HDFS, Hive and other BigData technologies.
• Familiarity with AWS (Glue EMR) etc. is good to have.
• Familiarity with Data warehousing and ETL concepts and techniques
• Having expertise in Database concepts and SQL/NoSQL operations.
• UNIX shell scripting will be an added advantage in scheduling/running application jobs.
• At least 5 years of experience in Project development life cycle activities and maintenance/support projects.
• Work in an Agile environment and participation in scrum daily standups, sprint planning reviews and retrospectives.
• Understand project requirements and translate them into technical solutions which meets the project quality standards
• Ability to work in team in diverse/multiple stakeholder environment and collaborate with upstream/downstream functional teams to identify, troubleshoot and resolve data issues.
• Strong problem solving and Good Analytical skills.
• Excellent verbal and written communication skills.
• Experience and desire to work in a Global delivery environment.
• Stay up to date with new technologies and industry trends in Development.

Educational Requirement

Bachelor of Engineering,Bachelor Of Technology

Preferred Skills

Technology->Data Engineering->Spark,Technology->Java->Apache->Spark

Service Line

Data Analytics Unit