Data Engineer / Big Data Engineer / Cloud Data Engineer

Consult Asia; Dadri; On-site; INR 1,200,000 - 2,500,000; Full time

Job summary

Consult Asia is seeking a data engineer to design, build, and maintain scalable data pipelines using Python, SQL and Spark. You will develop batch and streaming solutions with Kafka and Airflow, and manage cloud data platforms (Azure/AWS) to ensure high-quality data for analytics and AI use cases.

Ideal candidates have hands-on experience with Python, SQL, Spark and ETL pipelines, plus Kafka, Airflow and cloud platforms. Snowflake/Databricks expertise is preferred.

Qualifications

• Experience in Python, SQL, Spark, and ETL pipelines.
• Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS).
• Snowflake/Databricks expertise preferred.

Responsibilities

• Design, build, and maintain scalable data pipelines using Python, SQL & Spark.
• Develop batch and streaming solutions with Kafka and Airflow.
• Manage cloud data platforms (Azure/AWS) and ensure high-quality reliable data for analytics and AI use cases.

Skills

Python

SQL

Spark

ETL pipelines

Kafka

Airflow

Azure

AWS

Tools

Snowflake

Databricks

Snowflake/Databricks

Job description

Design, build, and maintain scalable data pipelines using Python, SQL & Spark. Develop batch and streaming solutions with Kafka and Airflow. Manage cloud data platforms (Azure/AWS) & ensure high-quality reliable data for analytics and AI use cases.

Required Candidate profile

Experience in Python, SQL, Spark, and ETL pipelines. Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS). Expertise in Snowflake/Databricks preferred.