Big Data Engineer

eazygurus; Hyderabad; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

eazygurus is seeking a skilled Big Data Engineer to design, build, and maintain scalable data platforms. The role focuses on processing large volumes of structured and unstructured data to support analytics and data science initiatives.

The ideal candidate will design, develop, and optimize data pipelines using Hadoop, Spark, Hive, and Kafka, with proficiency in Python/Scala/Java and experience with SQL and NoSQL databases. Remote/On-site/Hybrid options are available.

Qualifications

• Experience with big data architectures and data pipelines.
• Proficiency in Python, Scala, or Java for data processing.
• Strong SQL/NoSQL experience and data warehousing knowledge.
• Hands-on with streaming and real-time processing and cloud platforms.
• Familiarity with data governance, security, and compliance standards.
• Excellent problem-solving and analytical abilities.

Responsibilities

• Design, develop, and maintain large-scale data pipelines.
• Optimize ETL/ELT processes for high-volume ingestion.
• Work with Hadoop, Spark, Hive, and Kafka in distributed systems.
• Collaborate with data scientists, analysts, and engineers.
• Ensure data quality, reliability, and performance.
• Monitor pipelines and control costs; stay updated on technologies.

Skills

Big data technologies (Hadoop, Spark, 

Education

Bachelor’s/Master’s in CS or Data Engineering

Tools

Airflow

Oozie

Kubernetes

Delta Lake

Iceberg

Hudi

Job description

Experience: 4–10 Years
Location: Remote / On-site / Hybrid
Employment Type: Full-time / Contract

Job Description

We are looking for an experienced Big Data Engineer to design, build, and maintain scalable data pipelines and big data platforms. The role focuses on processing large volumes of structured and unstructured data to support analytics, reporting, and data science initiatives.

Key Responsibilities

• Design, develop, and maintain large-scale data pipelines
• Build and optimize ETL/ELT processes for high-volume data ingestion
• Work with big data frameworks and distributed systems
• Ensure data quality, reliability, and performance
• Collaborate with data scientists, analysts, and software engineers
• Implement data security, governance, and compliance standards
• Monitor and troubleshoot data pipelines and workflows
• Optimize data storage and processing costs
• Stay updated with big data technologies and best practices

Required Skills & Qualifications

• Strong experience with big data technologies (Hadoop, Spark, Hive, Kafka)
• Proficiency in programming languages such as Python, Scala, or Java
• Experience with SQL and NoSQL databases
• Hands-on experience with data streaming and real-time processing
• Experience with cloud platforms (AWS, Azure, GCP)
• Knowledge of data warehousing and data lakes
• Familiarity with workflow orchestration tools (Airflow, Oozie)
• Strong problem-solving and analytical skills

Preferred Qualifications

• Experience with cloud-native big data services (EMR, Databricks, BigQuery, Synapse)
• Knowledge of Delta Lake, Iceberg, or Hudi
• Experience with containerization and Kubernetes
• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field

What We Offer

• Opportunity to work on large-scale, data-intensive systems
• Exposure to modern big data and cloud technologies
• Competitive compensation and benefits
• High-impact role with ownership and growth opportunities
• Collaborative and data-driven work environment