Pyspark+Scala+SQL+Hive+Airflow (Data analyst)

LTM; Hyderabad; On-site; INR 2,000,000 - 3,800,000; Full time

Job summary

LTM is seeking a Senior Data Engineer in Hyderabad to join the FX Conduct Team. The role focuses on building robust data assets using cutting-edge technologies including Apache Spark, Scala, Hadoop, and GCP for financial domain applications.

The ideal candidate will have hands-on experience with big data frameworks, strong programming skills, and the ability to work in global teams. Proactive learning and adaptability are valued in this dynamic environment.

Qualifications

• 5 years of hands-on experience with Apache Spark and Scala.
• Strong programming skills in Scala; Java knowledge is a plus.
• Deep knowledge of Hadoop tools such as HDFS and Hive.
• Excellent verbal and written English communication.
• Proven experience in writing unit tests.

Responsibilities

• Build robust and scalable data assets using Spark, Hadoop, and cloud platforms.
• Collaborate with global teams to implement data solutions for financial domain.
• Develop data pipelines and ensure data quality and governance.

Skills

Apache Spark

Scala

Java

English communication

Unit testing

Tools

HDFS

Hive

Elasticsearch

RESTful API

CI/CD

GCP

Hadoop

Job description

Role Description

Job Specification Senior Data Engineer

Experience Level 5 years

Role Overview We are seeking a strong Senior Data Engineer to join FX Conduct Team This team is responsible for building robust and scalable data assets leveraging cuttingedge technologies including Apache Spark Scala Hadoop Elastic Search and GCP The ideal candidate will bring expertise in big data frameworks handson experience with Hadoop and cloud platforms and a passion for solving complex data challenges in financial domain Candidate must have the ability to understand and develop the logical flow of applications on technical code level Strong interpersonal skills and ability to work in a team and in global environments Candidate should be proactive have learning attitude adjust to work in dynamic work environments

Required Skills And Experience

• Big data Expertise 5 years of handson experience with Apache Spark and Scala
• Programming Strong Programming skills in Scala and familiarity with other languages like Java is plus
• Hadoop Ecosystem Indepth knowledge of Hadoop tools such as HDFS and Hive
• Communication Skills Strong verbal and written communication skills in English to convey technical concepts to both technical and nontechnical stakeholders
• Unit Testing Strong experience in writing unit tests

Preferred Qualifications

• Experience in financial services domain
• Knowledge of CICD practices for data engineering
• Experience in Elastic search
• Experience in Restful API development
• Experience in Agile software development methodologies
• Exposure to data governance and compliance practices