Big Data Engineer (Spark, Scala)

Dataconsol Private Limited; Hyderabad; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Dataconsol Private Limited is seeking a Big Data Engineer in Hyderabad to design and implement scalable data processing solutions using Spark and Scala. You will build and maintain ETL pipelines, process large volumes of structured and unstructured data, and collaborate with data teams to deliver data-driven solutions.

The role focuses on data quality, performance, and reliability across big data environments, with code reviews and deployment of data applications on cloud platforms in an Agile

Qualifications

• Bachelor’s degree in CS/IT or related field.
• 4–6 years of experience with Big Data technologies.
• Strong experience with Apache Spark and Scala programming.
• Experience with distributed data processing frameworks.
• Knowledge of data warehousing, ETL processes, and data modeling.
• Experience working in Agile development environments.
• Strong analytical and problem-solving skills.

Responsibilities

• Design and implement scalable data processing solutions using Spark and Scala.
• Develop and maintain ETL pipelines to process large volumes of structured and unstructured data.
• Collaborate with data engineers, analysts, and product teams to build data-driven solutions.
• Perform data transformation, aggregation, and optimization for analytical workloads.
• Ensure data quality, reliability, and performance across big data environments.
• Participate in code reviews and maintain coding standards.
• Troubleshoot production issues and optimize data processing workflows.
• Deploy and manage data applications on cloud platforms.

Skills

Analytical skills

Education

Bachelor’s degree in Computer Science/IT or related field

Tools

Apache Spark

Scala programming

Job description

Big Data Engineer with experience in Spark and Scala for building scalable data processing pipelines. Skilled in working with large datasets, implementing ETL workflows, and deploying data solutions on modern big data platforms and cloud environments.

Job Description:

• Design and implement scalable data processing solutions using Spark and Scala.
• Develop and maintain ETL pipelines to process large volumes of structured and unstructured data.
• Collaborate with data engineers, analysts, and product teams to build data-driven solutions.
• Perform data transformation, aggregation, and optimization for analytical workloads.
• Ensure data quality, reliability, and performance across big data environments.
• Participate in code reviews and maintain coding standards.
• Troubleshoot production issues and optimize data processing workflows.
• Deploy and manage data applications on cloud platforms.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or related field.
• 4–6 years of experience working with Big Data technologies.
• Strong experience with Apache Spark and Scala programming.
• Experience working with distributed data processing frameworks.
• Knowledge of data warehousing, ETL processes, and data modeling.
• Experience working in Agile development environments.
• Strong analytical and problem-solving skills.

We partner with organizations of all sizes — from growing startups to established enterprises — delivering tailored IT and consulting solutions that drive measurable results.

Our clients trust us for our expertise, reliability, and commitment to long-term success. We build strong, collaborative relationships focused on innovation, efficiency, and sustainable growth.