Big Data / PySpark Developer

VMC Soft Technologies, Inc; Karnataka; Sur place; INR 900 000 - 1 200 000; Plein temps

Résumé du poste

VMC Soft Technologies, Inc. is seeking a Big Data / PySpark Developer to join onsite roles across India. The candidate should have 4–6 years of experience in Big Data, Hadoop ecosystems, data warehousing, and cloud technologies.

Position supports Chennai, Bangalore, or Hyderabad locations with immediate joiners preferred. You will develop PySpark/Scala jobs, optimize Hive/SQL, and collaborate with cross-functional teams in a DevOps/Agile environment.

Qualifications

• 4–6 years of experience in Big Data and PySpark
• Experience with Hadoop ecosystem including Hive, Spark, and data warehousing
• Knowledge of cloud technologies and data processing pipelines

Responsabilités

• Develop and maintain Big Data applications using Hadoop, Hive, Spark, PySpark and related tools.
• Develop Scala/Spark jobs for data transformation, processing, aggregation, and analytics.
• Work with large-scale data processing and HDFS concepts.
• Optimize Hive/SQL queries and perform query tuning and performance enhancement.
• Develop, test, deploy, and support applications across development and production environments.
• Handle environment setup, connectivity, deployment, and production implementation activities.
• Work with stream-processing technologies such as Spark Streaming, Storm, or Flink.
• Follow DevOps and Agile development practices throughout the software development lifecycle.
• Collaborate effectively with cross-functional teams in a complex organizational environment.
• Understand and apply banking domain terminology and processes.
• Take ownership of small to medium-sized projects and act as a primary technical contact when required.
• Troubleshoot technical issues and demonstrate strong problem-solving and analytical skills.

Connaissances

Big Data

PySpark

Hadoop

Hive

Spark

SQL

Scala

HDFS

Cloud

DevOps

Agile

Description du poste

Hiring: Big Data / PySpark Developer

Job Title: Big Data / PySpark Developer

Experience: 4 6 Years

Location: Chennai, Bangalore, Hyderabad

Work Mode: Onsite

Notice Period: Immediate Joiners Preferred Job Description

We are looking for an experienced Big Data / PySpark Developer with 4 6 years of experience in Big Data, Hadoop ecosystems, data warehousing, and cloud technologies.

Key Responsibilities

• Develop and maintain Big Data applications using Hadoop, Hive, Spark, PySpark and related Big Data ecosystem tools.
• Develop Scala/Spark jobs for data transformation, processing, aggregation, and analytics.
• Work with large-scale data processing and HDFS concepts.
• Optimize Hive/SQL queries and perform query tuning and performance enhancement.
• Develop, test, deploy, and support applications across development and production environments.
• Handle environment setup, connectivity, deployment, and production implementation activities.
• Work with stream-processing technologies such as Spark Streaming, Storm, or Flink.
• Follow DevOps and Agile development practices throughout the software development lifecycle.
• Collaborate effectively with cross-functional teams in a complex organizational environment.
• Understand and apply banking domain terminology and processes.
• Take ownership of small to medium-sized projects and act as a primary technical contact when required.
• Troubleshoot technical issues and demonstrate strong problem-solving and analytical skills.

Required Skills

• Strong hands-on experience with Hadoop, Hive, Spark and PySpark.
• Good knowledge of Big Data ecosystem tools.
• Strong SQL skills, including query optimization and performance tuning.
• Experience with Scala/Spark development.
• Good understanding of HDFS and distributed data processing.
• Experience with stream processing Spark Streaming / Storm / Flink.
• Knowledge of DevOps practices and Agile methodologies.
• Good understanding of Cloud Computing, preferably AWS or Azure.
• Strong understanding of Object-Oriented Programming concepts.
• Good analytical, troubleshooting, and problem-solving skills.
• Exposure to Banking/Financial Services domain is preferred.
• Ability to work independently and collaboratively in a complex organization.

Preferred Skills

PySpark | Hadoop | Spark | Hive | SQL | Scala | HDFS | Spark Streaming | AWS/Azure | DevOps | Agile | Banking Domain

Candidate Preference

Immediate Joiners Are Highly Preferred.