Data Engineer / Big Data Engineer / Cloud Data Engineer

Consult Asia; Ahmedabad District; Presencial; INR 1.200.000 - 1.900.000; Jornada completa

Descripción de la vacante

Consult Asia in Ahmedabad is seeking a data engineer to design, build, and maintain scalable data pipelines using Python, SQL, and Spark for analytics and AI use cases.

You will work with batch and streaming solutions, leveraging Kafka and Airflow, and manage cloud data platforms on Azure and AWS to ensure high-quality data delivery.

Experience with Snowflake or Databricks is preferred.

Formación

• Experience in Python, SQL, Spark, and ETL pipelines.
• Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS).
• Expertise in Snowflake/Databricks preferred.

Responsabilidades

• Design, build, and maintain scalable data pipelines.
• Develop batch and streaming solutions with Kafka and Airflow.
• Manage cloud data platforms (Azure/AWS) for analytics and AI use cases.

Conocimientos

Python

SQL

Spark

ETL pipelines

Herramientas

Kafka

Airflow

Azure

AWS

Snowflake

Databricks

Descripción del empleo

Design, build, and maintain scalable data pipelines using Python, SQL & Spark. Develop batch and streaming solutions with Kafka and Airflow. Manage cloud data platforms (Azure/AWS) & ensure high-quality reliable data for analytics and AI use cases.

Required Candidate profile

Experience in Python, SQL, Spark, and ETL pipelines. Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS). Expertise in Snowflake/Databricks preferred.