Big Data Engineer

Cashback24x7; India; Remote; INR 5,174,000 - 10,348,000; Part time

Job summary

Cashback24x7 is seeking a Big Data Engineer for a remote contractor role. You will design, build and maintain scalable data pipelines and architectures to support robust data solutions, helping AI systems learn from high-quality real-world input.

You will collaborate with cross-functional teams to deliver on data requirements, implement ETL and processing using Python, and optimize distributed databases for efficiency and reliability in a remote work environment.

Qualifications

• Proven expertise in big data engineering and building large-scale data pipelines.
• Advanced proficiency in Python for data processing and integration.
• Strong knowledge of relational and NoSQL databases and optimization techniques.
• Experience with distributed data processing frameworks (Hadoop, Spark, Flink).
• Solid foundation in data modeling, ETL, and data warehousing principles.

Responsibilities

• Design, build, and maintain scalable big data pipelines and architectures.
• Collaborate with cross-functional teams to understand data requirements and objectives.
• Implement data integration, transformation, and processing solutions using Python and big data tools.
• Develop, manage, and optimize distributed databases and storage systems.
• Monitor and troubleshoot data systems to ensure high availability and performance.
• Enforce data quality, security, and governance standards across solutions.
• Document solutions and communicate technical concepts clearly to stakeholders.

Skills

Big data pipelines

Python programming

Relational DBs

NoSQL DBs

Distributed processing

Data modeling

ETL processes

Cloud platforms

ML workflows

Tools

Hadoop

Spark

Flink

SQL

Job description

Job Title: Big Data Engineer
Job Type: Contractor
Location: Remote

Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input.

Key Responsibilities:

• Design, build, and maintain scalable big data pipelines and architectures to support robust data solutions.
• Collaborate with cross-functional teams to understand and deliver on data requirements and business objectives.
• Implement data integration, transformation, and processing solutions using Python and relevant big data technologies.
• Develop, manage, and optimize distributed databases and storage systems for efficiency and reliability.
• Monitor, troubleshoot, and enhance data systems to ensure high availability and performance.
• Enforce data quality, security, and governance standards across all solutions.
• Document solutions and communicate complex technical concepts effectively, both in writing and verbally.

Required Skills and Qualifications:

• Proven expertise in big data engineering with hands-on experience building and maintaining large-scale data pipelines.
• Advanced proficiency in Python for data processing, automation, and integration.
• Deep understanding of relational and NoSQL databases, including optimization and management techniques.
• Experience with distributed data processing frameworks (e.g., Hadoop, Spark, Flink).
• Strong foundation in data modeling, ETL processes, and data warehousing principles.
• Excellent written and verbal communication skills, with the ability to convey technical ideas clearly to both technical and non-technical stakeholders.
• Detail-oriented, proactive, and self-motivated, thriving in remote and autonomous work environments.

Preferred Qualifications:

• Prior experience in fast-paced or startup-like environments supporting global teams.
• Expertise with cloud-based big data platforms (e.g., AWS, GCP, Azure).
• Familiarity with machine learning operations and data science workflows is a plus.