Big Data Engineer

Purview Services; Greater Noida; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Purview Services in Greater Noida, India, is seeking a skilled Big Data Engineer to design, develop, and optimize large-scale data architectures. The role focuses on building robust data pipelines, ensuring data quality, and implementing scalable solutions across cross-functional teams.

Candidates should be proficient in Hadoop, Spark, NoSQL, and programming languages like Java, Python, or Scala, with experience in agile environments and version control.

Qualifications

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.
• Experience working with large datasets and developing scalable big data solutions.
• Strong programming skills in languages such as Java, Python, or Scala.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
• Familiarity with agile development methodologies and version control systems like Git.

Responsibilities

• Design, develop, and implement big data solutions using various technologies.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain large-scale data pipelines and architectures.
• Ensure data quality and integrity by implementing data validation and testing procedures.
• Optimize big data systems for performance and scalability.
• Stay updated with industry trends and emerging technologies in big data engineering.

Skills

Big data concepts

Hadoop

Spark

NoSQL databases

Large datasets

Scalable solutions

Java

Python

Scala

Problem-solving

Team collaboration

Agile

Tools

Git

Job description

Roles and Responsibility

• Design, develop, and implement big data solutions using various technologies.


• Collaborate with cross-functional teams to identify business requirements and develop solutions.


• Develop and maintain large-scale data pipelines and architectures.


• Ensure data quality and integrity by implementing data validation and testing procedures.


• Optimize big data systems for performance and scalability.


• Stay updated with industry trends and emerging technologies in big data engineering.

Job Requirements

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.


• Experience working with large datasets and developing scalable big data solutions.


• Strong programming skills in languages such as Java, Python, or Scala.


• Excellent problem-solving skills and attention to detail.


• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.


• Familiarity with agile development methodologies and version control systems like Git.