Data engineer

Infosys; Bengaluru; On-site; INR 1,200,000 - 1,900,000; Full time

Job summary

Infosys in Bengaluru is seeking a seasoned Data Engineer to design and implement scalable data pipelines using Apache Spark, Scala, Hive, and Kafka. You will work on distributed data processing and build data-driven applications within cloud-native architectures.

In an Agile environment, you will collaborate with architects and cross-functional teams, contribute to end-to-end development, develop high-performance data processing frameworks, and continuously learn emerging technologies to drive

Qualifications

• Experience with Big Data technologies and data pipelines.
• Hands-on expertise with Apache Spark, Scala, Hive, and Kafka.
• Strong understanding of distributed data processing.
• Experience with cloud platforms and cloud-native architectures.
• Knowledge of software engineering best practices and Agile methodologies.
• Strong problem-solving and analytical skills.
• Ability to design scalable data solutions and platforms.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Build data processing frameworks for large-scale platforms.
• Collaborate with cross-functional teams to deliver data-driven solutions.
• Participate in end-to-end SDLC in Agile environments.
• Contribute to architecture, design, coding, testing, and deployment of enterprise solutions.
• Engage with open-source communities and technology ecosystems.
• Continuously learn and upskill on emerging technologies.

Skills

Big Data technologies

Apache Spark

Scala

Hive

Kafka

Distributed data processing

Data pipeline development

Cloud platforms

Cloud-native architectures

Software engineering best practices

Agile methodologies

Problem-solving

Analytical skills

Job description

• Strong experience in Big Data Technologies
• Hands-on expertise in: o Apache Spark o Scala o Hive o Kafka
• Strong understanding of distributed data processing and data pipeline development.
• Experience working with cloud platforms and cloud-native architectures.
• Proficiency in software engineering best practices, design patterns, and Agile methodologies.
• Strong problem-solving and analytical skills.
• Design, develop, and implement scalable data engineering solutions using modern Big Data technologies.
• Build and maintain large-scale digital platforms, marketplaces, and data-driven applications.
• Work on complex engineering projects utilizing cloud-native architectures and distributed systems.
• Collaborate with cross-functional teams, architects, and fellow Power Programmers to deliver innovative solutions.
• Participate in end-to-end software development lifecycle activities in Agile environments.
• Develop high-performance data pipelines and data processing frameworks.
• Contribute to the architecture, design, coding, testing, and deployment of enterprise solutions.
• Co-create new products, platforms, and technology accelerators for clients.
• Engage with technology communities, open-source initiatives, and user groups.
• Continuously learn and upskill on emerging technologies and industry trends.