Big Data Engineer

Purview Services; Khordha; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Purview Services in Odisha, India, seeks a Big Data Engineer to design, develop, and implement scalable data solutions. The role involves collaborating with cross-functional teams to translate business needs into robust data pipelines and architectures.

Candidates should have strong skills in Hadoop, Spark, and NoSQL, with proficiency in Java, Python, or Scala, and a track record of delivering data quality through validation and testing.

Qualifications

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.
• Experience with large datasets and scalable big data solutions.
• Proficient in Java, Python, or Scala.

Responsibilities

• Design, develop, and implement big data solutions using various technologies.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain large-scale data pipelines and architectures.
• Ensure data quality and integrity by implementing data validation and testing procedures.
• Optimize big data systems for performance and scalability.
• Stay updated with industry trends and emerging technologies in big data engineering.

Skills

Big data concepts

Hadoop

Spark

NoSQL

Java

Python

Scala

Problem solving

Team collaboration

Effective communication

Agile

Git

Job description

Roles and Responsibility

• Design, develop, and implement big data solutions using various technologies.


• Collaborate with cross-functional teams to identify business requirements and develop solutions.


• Develop and maintain large-scale data pipelines and architectures.


• Ensure data quality and integrity by implementing data validation and testing procedures.


• Optimize big data systems for performance and scalability.


• Stay updated with industry trends and emerging technologies in big data engineering.

Job Requirements

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.


• Experience working with large datasets and developing scalable big data solutions.


• Strong programming skills in languages such as Java, Python, or Scala.


• Excellent problem-solving skills and attention to detail.


• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.


• Familiarity with agile development methodologies and version control systems like Git.