Power Programmer - Senior Technologist. Data Engineering (Q2-FY-26)

Infosys; Bengaluru; On-site; INR 2,200,000 - 4,000,000; Full time

Job summary

Infosys Bengaluru seeks a seasoned Big Data engineer to design and implement scalable data solutions using Spark, Scala, and Hadoop in cloud-native architectures. You will contribute end-to-end on technology-oriented projects and collaborate with cross-functional teams in an Agile environment.

You will work on large-scale digital platforms, develop ETL/ELT pipelines, and participate in open source communities to drive innovation.

Qualifications

• Bachelor's degree in BE/BTech is required.
• Extensive Spark experience with Scala in Hadoop environment.
• Experience with AWS data services and ETL/ELT pipelines.
• Hands-on Git and code versioning practices.
• Strong knowledge of data structures and algorithms.

Responsibilities

• Design and code to stay ahead of the technology curve.
• End-to-end contribution to technology-oriented development projects.
• Provide scalable solutions with minimal system requirements in Agile mode.
• Collaborate with power programmers and active in OSS/community.
• Develop new platform solutions and work on large-scale digital platforms.
• Engage in cloud-native architecture projects for complex engineering tasks.

Skills

Spark Jobs (Scala)

Scala programming

Hadoop ecosystem

AWS Glue

AWS Redshift/Spectrum

AWS S3

Spark Core

Spark SQL

Airflow

Oozie

Git

Data pipelines

Python

Scala functional programming

Education

Bachelor of Engineering/Bachelor Of Technology

Tools

Scala

Spark

Hadoop

Airflow

Oozie

Git

HDFS

Parquet/Avro/JSON

Job description

Educational Requirements

Bachelor of Engineering,Bachelor Of Technology

Service Line Strategic Technology Group

Responsibilities

• They will be ahead of the technology curve and will be constantly enabled and trained to be Polyglots.
• They are Go-Getters with a drive to solve end customer challenges and will spend most of their time in designing and coding
• End to End contribution to technology oriented development projects.
• Providing solutions with minimum system requirements and in Agile Mode.
• Collaborate with Power Programmers.
• Open Source community and Tech User group.
• Custom Development of new Platforms Solutions, Opportunities.
• Work on Large Scale Digital Platforms and marketplaces.
• Work on Complex Engineering Projects using cloud native architecture
• Work with innovative Fortune 500 companies in cutting edge technologies.

Additional Responsibilities:

• MandatoryAWS Glue, AWS Redshift/Spectrum, S3, API Gateway, Athena, Step and Lambda functions
• Experience in Extract Transform Load (ETL) and Extract Load Transform (ELT) data integration pattern.
• Experience in designing and building data pipelines.
• Development experience in one or more object-oriented programming languages, preferably Python

Technical and Professional Requirements:

• Indepth hands on experience of developing, testing, deployment and debugging of Spark Jobs using Scala in Hadoop Platform
• In depth knowledge of Spark Core, working with RDDs, Spark SQL
• In depth knowledge on Spark Optimization Techniques and Best practices
• Good Knowledge of Scala Functional Programming: Try, Option, Future, Collections
• Good Knowledge of Scala OOPS: Classes, Traits and Objects (Singleton and Companion), Case Classes.
• Scala Language Features: Type System, Implicit/Givens
• Hands on experience of working in Hadoop Environment (HDFS/Hive), AWS S3, EMR, Workflow Orchestration tools like Airflow, Oozie
• Understanding and exposure to file formats such as Apache AVRO, Parquet, JSON
• Writing Test cases using frameworks such as scalatest.
• Experience on using GIT, resolving conflicts, working with branches.
• Strong programming skills using data structures and algorithms.

Preferred Skills:

• Technology->Big Data->Big Data - ALL
• Technology->Big Data - Hadoop->Hadoop
• Technology->Java->Apache->Kafka
• Technology->Functional Programming->Scala
• Technology->Big Data - Data Processing->Spark