Big Data Engineer

Purview Services; Coimbatore District; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Purview Services is seeking a Big Data Engineer in Tamil Nadu, Coimbatore, to design and implement scalable data pipelines using Hadoop, Spark and NoSQL technologies.

You will collaborate with cross-functional teams to identify business requirements, develop data solutions, and ensure data quality and performance at scale. The role requires strong programming skills, teamwork and agile practices, with Git for version control.

Qualifications

• Proficient in Java, Python or Scala with strong coding skills.
• Experience designing and building large-scale data pipelines.
• Hands-on experience with Hadoop/Spark and NoSQL databases.
• Ability to collaborate with cross-functional teams and stakeholders.
• Understanding of data quality and validation processes.
• Familiarity with Agile development and version control (Git).

Responsibilities

• Design and implement big data solutions using various technologies.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain large-scale data pipelines and architectures.
• Ensure data quality and integrity through validation and testing procedures.
• Optimize big data systems for performance and scalability.
• Stay updated with industry trends in big data engineering.

Skills

Java

Python

Scala

Team collaboration

Problem solving

Communication with stakeholders

Agile methodologies

Tools

Hadoop

Spark

NoSQL databases

Git

Job description

Roles and Responsibility

• Design, develop, and implement big data solutions using various technologies.


• Collaborate with cross-functional teams to identify business requirements and develop solutions.


• Develop and maintain large-scale data pipelines and architectures.


• Ensure data quality and integrity by implementing data validation and testing procedures.


• Optimize big data systems for performance and scalability.


• Stay updated with industry trends and emerging technologies in big data engineering.

Job Requirements

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.


• Experience working with large datasets and developing scalable big data solutions.


• Strong programming skills in languages such as Java, Python, or Scala.


• Excellent problem-solving skills and attention to detail.


• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.


• Familiarity with agile development methodologies and version control systems like Git.