Bigdata Scala Spark

LTM; Pune District, Mumbai, Bengaluru; On-site; INR 2,500,000 - 6,000,000; Full time

Job summary

LTM is seeking a senior data engineer to join our Pune-based team. The role focuses on building and maintaining robust data pipelines using Apache Spark and Scala, designing scalable big data platforms, and enabling real-time processing with streaming technologies.

The ideal candidate will have 6–12 years of experience in data engineering, strong knowledge of Hadoop ecosystem components (Spark, HBase, Hive) and hands-on experience in modern data processing architectures.

Qualifications

• 6–12 years of data engineering experience.
• Expertise in Data Engineering Development using Scala.
• Hands-on design and development of big data platform.
• Deep understanding of Spark, HBase, Hive and Hadoop ecosystem technologies.
• Deep understanding of streaming data architectures for real-time, low-latency processing.
• Experience with agile development methods including core values, guiding principles and key agile practices.
• Understanding of CI/CD concepts and practices.
• Experience with NoSQL technologies is a plus.

Responsibilities

• Develop and maintain big data pipelines using Spark and Scala.
• Design and implement streaming data processing with low latency.
• Collaborate in agile teams and apply CI/CD practices.
• Leverage NoSQL technologies where applicable and beneficial.

Skills

Apache Spark

Scala

Tools

Big Data Hadoop Ecosystem

Job description

Role & responsibilities

Location: Bangalore, Hyderabad, Chennai, Pune, Mumbai

Job Description:

• 6 to 12 years of experience
• Expertise in Data Engineering Development using Scala
• Handson experience in design and development of big data platform
• Deep understanding of modern data processing technology stacks Spark HBase Hive and other Hadoop ecosystem technologies
• Deep understanding of streaming data architectures and technologies for real time and low latency data processing
• Experience with agile development methods including core values guiding principles and key agile practices
• Understanding of the theory and application of Continuous Integration Delivery
• Experience with NoSQL technologies including column family graph document and key value data storage technologies is a plus
• Passion for software craftsmanship Experience in Financial Industry is a plus

Mandatory Skills : Apache Spark, Scala

Good to Have Skills : Big Data Hadoop Ecosystem, Spark SQL