Big Data Engineer with Pyspark - Chennai

Newt Global; Chennai District; On-site; INR 1,200,000 - 2,200,000; Full time

Job summary

LTIMindtree in Chennai (Porur) invites a Big Data Engineer with PySpark to join our Banking & Financial Services practice. The role focuses on building large-scale data pipelines using PySpark, Spark, Hadoop components, and cloud platforms.

You will work with cross-functional teams in an Agile environment to design, develop, test, and optimize data lake solutions. 5+ years IT experience and strong banking domain background are highly preferred; immediate joiners are encouraged to apply.

Qualifications

• 5+ years IT experience with strong big data development.
• Hands-on PySpark and Spark ecosystem experience.
• Strong SQL development and data analysis skills.
• Experience with Hadoop (Hive, HDFS, Yarn).
• Knowledge of data warehousing concepts and ETL processes.
• Experience with cloud platforms (AWS/Azure/GCP).
• Familiarity with Git, CI/CD and Agile methodologies.
• Strong problem solving and communication skills.
• Banking/financial services domain experience preferred.

Skills

Big Data development

PySpark

Apache Spark

SQL development

Hadoop

ETL

Cloud platforms

Git

CI/CD

Agile methodologies

Communication skills

Banking domain experience

Education

Bachelor's degree

Master's degree

Computer Science

Information Technology

Tools

Databricks

Kafka

Spark Streaming

Delta Lake

Scala

Java

Job description

Job Description Big Data Engineer (PySpark) |(LTM)

Position:Big Data Engineer (PySpark)
Experience:5+ Years
Domain:Banking & Financial Services

.

Required Skills

• Overall5+ years of IT experiencewith strong Big Data development expertise.
• Hands-on experience inPySparkand Apache Spark ecosystem.
• Strong SQL development and data analysis skills.
• Experience with Hadoop technologies (Hive, HDFS, Yarn).
• Good understanding of data warehousing concepts and ETL processes.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Familiarity with Git, CI/CD processes, and Agile methodologies.
• Strong problem-solving and communication skills.

Banking Domain Experience (Mandatory)

• Minimum 2+ years of experience in Banking or Financial Services projects.
• Understanding of banking data models, customer data, transactions, loans, payments, deposits, and regulatory reporting.
• Exposure to Risk, Compliance, AML, KYC, or Financial Reporting processes will be an added advantage.

Preferred Skills

• Experience with Databricks.
• Knowledge of Kafka and Spark Streaming.
• Delta Lake/Lakehouse architecture exposure.
• Basic knowledge of Scala or Java.

Qualification

• Bachelor's or Master's degree in Computer Science, Information Technology, or related field.

Work Location

• LTIMindtree, Porur, Chennai

Preferred Candidates

• Immediate joiners or candidates with up to 30 days notice period.
• Strong banking domain background coupled with hands-on PySpark development experience.