Big Data Engineer

Purview Services; Dadri; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Purview Services in India is seeking a Big Data Engineer to design, develop, and implement big data solutions across diverse technologies. You will collaborate with cross-functional teams to translate business requirements into scalable data architectures and pipelines.

You will ensure data quality and integrity through validation and testing, optimize systems for performance, and stay abreast of industry trends and emerging technologies in big data engineering.

Qualifications

• Experience designing and implementing large-scale data processing pipelines.
• Ability to work with cross-functional teams to gather requirements.
• Strong focus on data quality, validation, and testing.
• Experience with performance tuning and scalability of big data systems.
• Familiarity with industry trends and emerging technologies in big data.

Responsibilities

• Design, develop, and implement big data solutions using various technologies.
• Collaborate with cross-functional teams to identify business requirements and develop solutions.
• Develop and maintain large-scale data pipelines and architectures.
• Ensure data quality and integrity by implementing data validation and testing procedures.
• Optimize big data systems for performance and scalability.
• Stay updated with industry trends and emerging technologies in big data engineering.

Skills

Team collaboration

Problem solving

Attention to detail

Effective communication

Agile mindset

Tools

Hadoop

Spark

NoSQL

Git

Java

Python

Scala

Job description

Roles and Responsibility

• Design, develop, and implement big data solutions using various technologies.


• Collaborate with cross-functional teams to identify business requirements and develop solutions.


• Develop and maintain large-scale data pipelines and architectures.


• Ensure data quality and integrity by implementing data validation and testing procedures.


• Optimize big data systems for performance and scalability.


• Stay updated with industry trends and emerging technologies in big data engineering.

Job Requirements

• Strong understanding of big data concepts and technologies such as Hadoop, Spark, and NoSQL databases.


• Experience working with large datasets and developing scalable big data solutions.


• Strong programming skills in languages such as Java, Python, or Scala.


• Excellent problem-solving skills and attention to detail.


• Ability to work collaboratively in a team environment and communicate effectively with stakeholders.


• Familiarity with agile development methodologies and version control systems like Git.