Big Data Engineer

Purview Services; Indore District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Purview Services is seeking a Big Data Engineer to design, develop, and implement scalable data solutions in Indore. You will work with Hadoop, Spark, and NoSQL, building robust data pipelines and architectures while ensuring data quality and system performance.

The role requires strong programming skills (Java/Python/Scala) and collaboration with cross-functional teams. Ideal candidates will have hands-on experience with large datasets, agile practices, and Git version control, delivering

Qualifications

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.
• Experience working with large datasets and developing scalable big data solutions.
• Strong programming skills in languages such as Java, Python, or Scala.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
• Familiarity with agile development methodologies and version control systems like Git.

Responsibilities

• Design, develop, and implement big data solutions using various technologies.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain large-scale data pipelines and architectures.
• Ensure data quality and integrity by implementing data validation and testing procedures.
• Optimize big data systems for performance and scalability.
• Stay updated with industry trends and emerging technologies in big data engineering.

Skills

Hadoop

Spark

NoSQL

Java

Python

Scala

Data pipelines

Big data concepts

Git

Agile

Tools

Git

Job description

Roles and Responsibility

• Design, develop, and implement big data solutions using various technologies.


• Collaborate with cross-functional teams to identify business requirements and develop solutions.


• Develop and maintain large-scale data pipelines and architectures.


• Ensure data quality and integrity by implementing data validation and testing procedures.


• Optimize big data systems for performance and scalability.


• Stay updated with industry trends and emerging technologies in big data engineering.

Job Requirements

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.


• Experience working with large datasets and developing scalable big data solutions.


• Strong programming skills in languages such as Java, Python, or Scala.


• Excellent problem-solving skills and attention to detail.


• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.


• Familiarity with agile development methodologies and version control systems like Git.