Big Data Engineer

Purview Services; Faridabad District; On-site; INR 1,000,000 - 2,000,000; Part time

Job summary

Purview Services is seeking a Big Data Engineer to design, develop, and implement scalable data solutions in a dynamic team. You will build and maintain large-scale data pipelines, ensuring data quality and integrity across systems, and collaborate with cross-functional teams to meet business needs.

The role requires strong programming skills (Java, Python, or Scala), experience with Hadoop and Spark, and a solid understanding of NoSQL databases.

Qualifications

• Proficient in designing and implementing large-scale data pipelines.
• Experience with Hadoop, Spark, and NoSQL databases.
• Strong programming in Java, Python, or Scala; good problem-solving.

Responsibilities

• Design, develop, and implement big data solutions using various technologies.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain large-scale data pipelines and architectures.
• Ensure data quality and integrity by implementing data validation and testing procedures.
• Optimize big data systems for performance and scalability.
• Stay updated with industry trends and emerging technologies in big data engineering.

Skills

Big data concepts

Hadoop

Spark

NoSQL databases

Java

Python

Scala

Data pipelines

Agile

Git

Teamwork

Problem solving

Tools

Git

Job description

Roles and Responsibility

• Design, develop, and implement big data solutions using various technologies.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain large-scale data pipelines and architectures.
• Ensure data quality and integrity by implementing data validation and testing procedures.
• Optimize big data systems for performance and scalability.
• Stay updated with industry trends and emerging technologies in big data engineering.

Job Requirements

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.
• Experience working with large datasets and developing scalable big data solutions.
• Strong programming skills in languages such as Java, Python, or Scala.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a team environment and communicate effective with stakeholders.
• Familiarity with agile development methodologies and version control systems like Git.