Data Engineer

Alike Thoughts; Hyderabad, Pune District; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Alike Thoughts is seeking a Big Data Developer to design and implement scalable data processing solutions using Apache Spark and Scala in a Hyderabad-based environment. You will work on ETL pipelines, data transformations, and ensuring data quality across the Hadoop ecosystem.

The ideal candidate has hands-on experience with Spark, Hive, HDFS, Spark SQL, and SQL, and can optimize jobs for performance and reliability in production.

Qualifications

• Experience building Spark-based data pipelines.
• Strong SQL and data modeling skills.
• Familiarity with Hadoop components (HDFS, Hive, MapReduce).

Responsibilities

• Develop and maintain Spark/Scala-based big data applications.
• Build scalable data processing and ETL pipelines.
• Work with Hadoop ecosystem for storage and processing.
• Transform, cleanse, aggregate, and validate data.
• Optimize Spark jobs for performance and scalability.
• Troubleshoot data-processing issues in production.

Skills

Apache Spark

Scala

Hadoop Ecosystem

HDFS

Hive

Spark SQL

SQL

Job description

We are looking for a Big Data Developer with years of experience in Apache Spark, Scala, and the Hadoop Ecosystem.

Key Responsibilities:

• Develop and maintain Big Data applications using Apache Spark and Scala.
• Build and support scalable data processing and ETL pipelines.
• Work with the Hadoop ecosystem for distributed data storage and processing.
• Perform data transformation, cleansing, aggregation, and validation.
• Optimize Spark jobs for performance and scalability.
• Troubleshoot data-processing issues and support production applications.

Required Skills:

Apache Spark, Scala, Big Data, Hadoop Ecosystem, HDFS, Hive, Spark SQL, and SQL.