AWS Big Data Engineer

Zorba AI

Hyderabad

Presencial

INR 1.500.000 - 2.500.000

Jornada completa

Hace 2 días
Sé de los primeros/as/es en solicitar esta vacante

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Zorba AI is seeking an experienced AWS Big Data Engineer to design, build and optimize scalable data pipelines on AWS using Python/Scala, Spark, Hive and Hadoop. You will contribute to API‑driven backend services and distributed data applications in a fast‑moving environment.

Key responsibilities include developing batch and real‑time data processing solutions, tuning performance, and collaborating with data engineers, backend developers, QA, DevOps and product teams in an Agile/Scrum setup.

Formación

  • 5+ years in Big Data Engineering, distributed systems, or enterprise app development.
  • Hands-on AWS experience with S3, EC2, EMR, Lambda, DynamoDB, and API Gateway.
  • Proficient in Python or Scala.
  • Hands-on Spark, Hadoop, and Hive experience.
  • Strong Airflow experience with complex DAGs.
  • SQL and data engineering fundamentals.
  • Experience building API-driven backend services.
  • Experience with Git, Jenkins, and CI/CD.

Responsabilidades

  • Design, develop, test, and deploy scalable Big Data applications and data engineering solutions on AWS.
  • Develop API-driven backend services to manage, monitor, and govern large-scale batch data processing applications.
  • Build and maintain data pipelines using Spark, Python, Scala, SQL, Hive, and Hadoop.
  • Work with AWS services including S3, EC2, EMR, Lambda, DynamoDB, and API Gateway.
  • Design and enhance Airflow DAGs for workflow orchestration, scheduling, dependency management, monitoring, and failure handling.
  • Develop scalable batch and real-time data processing solutions.
  • Perform performance tuning, optimization, troubleshooting, and production support for distributed data applications.
  • Participate in architecture reviews, code reviews, testing, and deployment activities.
  • Collaborate with data engineers, backend developers, QA, DevOps, and product teams in an Agile/Scrum environment.
  • Implement automation, CI/CD practices, and operational improvements to enhance system reliability.

Conocimientos

AWS cloud services
Apache Spark
Python/Scala
Airflow
Big Data
Distributed systems
SQL
API development
Git
CI/CD

Educación

Bachelor's degree in CS/Engineering/Math

Herramientas

AWS
S3
EC2
EMR
Lambda
DynamoDB
API Gateway
Hive
Hadoop
Apache Spark
Airflow

Descripción del empleo

We are looking for an experienced AWS Big Data Engineer with strong expertise in Python/Scala, Apache Spark, AWS cloud services, and Apache Airflow. The ideal candidate will have hands‑on experience developing scalable data engineering solutions, API‑driven backend services, and distributed Big Data applications.

Key Responsibilities
  • Design, develop, test, and deploy scalable Big Data applications and data engineering solutions on AWS.
  • Develop API-driven backend services to manage, monitor, and govern large‑scale batch data processing applications.
  • Build and maintain data pipelines using Apache Spark, Python, Scala, SQL, Hive, and Hadoop.
  • Work with AWS services including S3, EC2, EMR, Lambda, DynamoDB, and API Gateway.
  • Design and enhance Apache Airflow DAGs for workflow orchestration, scheduling, dependency management, monitoring, and failure handling.
  • Develop scalable batch and real‑time data processing solutions.
  • Perform performance tuning, optimization, troubleshooting, and production support for distributed data applications.
  • Participate in architecture reviews, code reviews, testing, and deployment activities.
  • Collaborate with data engineers, backend developers, QA, DevOps, and product teams in an Agile/Scrum environment.
  • Implement automation, CI/CD practices, and operational improvements to enhance system reliability.
Mandatory Skills
  • 5+ years of experience in Big Data Engineering, distributed systems, or enterprise application development.
  • Strong hands‑on experience with AWS cloud services, particularly S3, EC2, EMR, Lambda, DynamoDB, and API Gateway.
  • Strong programming experience in Python or Scala.
  • Hands‑on experience with Apache Spark, Hadoop, and Hive.
  • Strong experience in Apache Airflow, including complex DAG development, scheduling, dependencies, monitoring, and error handling.
  • Strong SQL and data engineering fundamentals.
  • Experience developing APIs, backend services, or API‑driven applications.
  • Experience with Git, Jenkins, and CI/CD pipelines.
  • Good understanding of batch processing, data transformation, data quality, and performance optimization.
  • Experience working in Agile/Scrum environments.
Good to Have
  • Exposure to LLMs, Generative AI, Agentic AI, or AI‑assisted engineering.
  • Experience with REST APIs, microservices, event‑driven architecture, and serverless applications.
  • Knowledge of Infrastructure as Code and automated testing.li>
  • Experience with data governance, metadata management, data lineage, and data observability.
  • Bachelor's degree in Computer Science, Engineering, Mathematics, or a related technical discipline.
Key Skills
  • AWS
  • AWS EMR
  • Apache Spark
  • Python
  • Scala
  • Apache Airflow
  • Hadoop
  • Hive
  • SQL
  • S3
  • EC2
  • Lambda
  • DynamoDB
  • API Gateway
  • REST APIs
  • Microservices
  • Git
  • Jenkins
  • CI/CD
Skills
  • aws,rest apis,python,ci/cd,sql,microservices,git,scala,big data
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Big Data Applications Engineer_AWS
Big Data Applications Engineer_AWS

Zorba AI • Hyderabad

Presencial
INR 1.800.000 - 2.600.000
Aws Data Engineer
Aws Data Engineer

Qentelli LLC • Bengaluru

Presencial
INR 1.400.000 - 2.200.000
AWS & Airflow Developer
AWS & Airflow Developer

LPL Financials • Hyderabad

Híbrido
INR 1.200.000 - 1.800.000
AWS Data Engineer
AWS Data Engineer

Emids • Bengaluru

Presencial
INR 1.000.000 - 1.500.000
AWS Data Engineer
AWS Data Engineer

ExlService Holdings, Inc. • Bengaluru

Presencial
INR 1.200.000 - 2.200.000
Big Data Engineer
Big Data Engineer

HNM Systems • Hyderabad

Híbrido
INR 1.200.000 - 1.800.000
Big Data Engineer(AWS, Python,Airflow)
Big Data Engineer(AWS, Python,Airflow)

Zorba AI • Hyderabad

Presencial
INR 800.000 - 1.500.000
Big Data Engineer
Big Data Engineer

Zorba AI • Hyderabad

Presencial
INR 1.200.000 - 1.800.000
Data Engineer
Data Engineer

Grid Dynamics • Bengaluru

Híbrido
INR 900.000 - 1.400.000
AWS Data Engineer
AWS Data Engineer

Durapid Technologies Pvt Ltd • Hyderabad

Presencial
INR 900.000 - 1.350.000