Data Engineer / Big Data Engineer / Cloud Data Engineer

Consult Asia; Mumbai; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Consult Asia is seeking a data engineer to design, build, and maintain scalable data pipelines using Python, SQL, and Spark. You will develop batch and streaming solutions with Kafka and Airflow while managing cloud data platforms on Azure and AWS to ensure reliable data for analytics and AI use cases.

The role emphasizes hands-on work with Snowflake and Databricks and collaboration across analytics teams to deliver high-quality data products.

Qualifications

• Experience in Python, SQL, Spark, and ETL pipelines.
• Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS).
• Expertise in Snowflake/Databricks preferred.

Responsibilities

• Design, build, and maintain scalable data pipelines using Python, SQL and Spark.
• Develop batch and streaming solutions with Kafka and Airflow.
• Manage cloud data platforms (Azure/AWS) and ensure high-quality reliable data for analytics and AI use cases.

Skills

Python

SQL

Spark

ETL pipelines

Kafka

Airflow

Cloud platforms

Tools

Snowflake

Databricks

Job description

Design, build, and maintain scalable data pipelines using Python, SQL & Spark. Develop batch and streaming solutions with Kafka and Airflow. Manage cloud data platforms (Azure/AWS) & ensure high-quality reliable data for analytics and AI use cases.

Required Candidate profile

Experience in Python, SQL, Spark, and ETL pipelines. Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS). Expertise in Snowflake/Databricks preferred.