Big Data Engineer

Purview Services; Ghaziabad District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Purview Services is seeking a skilled Big Data Engineer to design, build, and optimize large-scale data solutions in our India office. The role emphasizes end-to-end data pipelines, data quality, and scalable architectures while collaborating with cross-functional teams to translate business needs into robust data solutions.

The ideal candidate has strong programming skills in Java, Python, or Scala, along with experience in Hadoop, Spark, and NoSQL technologies.

Qualifications

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.
• Experience working with large datasets and developing scalable big data solutions.
• Strong programming skills in languages such as Java, Python, or Scala.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
• Familiarity with agile development methodologies and version control systems like Git.

Responsibilities

• Design, develop, and implement big data solutions using various technologies.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain large-scale data pipelines and architectures.
• Ensure data quality and integrity by implementing data validation and testing procedures.
• Optimize big data systems for performance and scalability.
• Stay updated with industry trends and emerging technologies in big data engineering.

Skills

Big data concepts

Hadoop

Spark

NoSQL databases

Java

Python

Scala

Data quality

Team collaboration

Git

Tools

Git

Job description

Roles and Responsibility

• Design, develop, and implement big data solutions using various technologies.


• Collaborate with cross-functional teams to identify business requirements and develop solutions.


• Develop and maintain large-scale data pipelines and architectures.


• Ensure data quality and integrity by implementing data validation and testing procedures.


• Optimize big data systems for performance and scalability.


• Stay updated with industry trends and emerging technologies in big data engineering.

Job Requirements

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.


• Experience working with large datasets and developing scalable big data solutions.


• Strong programming skills in languages such as Java, Python, or Scala.


• Excellent problem-solving skills and attention to detail.


• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.


• Familiarity with agile development methodologies and version control systems like Git.