Big Data Engineer

Jumiva; India; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Jumiva in India seeks a data engineering professional to help train next-generation AI systems by providing high-quality real-world input for models. You will design scalable data pipelines and ensure data quality and governance.

You'll collaborate with cross-functional teams, implement data processing solutions in Python, and optimize distributed storage and databases for performance and reliability. The role emphasizes writing clear documentation and communicating complex technical concepts

Qualifications

• Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.
• Advanced proficiency in Python for data processing, automation, and integration.
• Deep understanding of relational and NoSQL databases, including optimization and management techniques.
• Experience with distributed data processing frameworks such as Hadoop, Spark, Flink.

Responsibilities

• Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.
• Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.
• Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.
• Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.
• Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.
• Enforce data quality, security, and governance standards across all solutions.
• Document solutions and communicate complex technical concepts effectively, both in writing and verbally.

Skills

Big data pipelines

Python data processing

Relational & NoSQL DBs

Distributed processing frameworks

Tools

Hadoop

Spark

Flink

Job description

Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.

Key Responsibilities:

1. Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.
2. Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.
3. Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.
4. Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.
5. Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.
6. Enforce data quality, security, and governance standards across all solutions.
7. Document solutions and communicate complex technical concepts effectively, both in writing and verbally.

Required Skills and Qualifications:

1. Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.
2. Advanced proficiency in Python for data processing, automation, and integration.
3. Deep understanding of relational and NoSQL databases, including optimization and management techniques.
4. Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink).