Data Engineer / Big Data Engineer / Cloud Data Engineer

Consult Asia; Kolkata District; On-site; INR 1,200,000 - 2,200,000; Full time

Job summary

Consult Asia in Kolkata seeks a data engineering professional to design, build, and maintain scalable data pipelines using Python, SQL and Spark. You will develop batch and streaming solutions with Kafka and Airflow, and work with cloud data platforms on Azure or AWS to deliver reliable data for analytics and AI use cases.

The role requires hands-on experience with ETL pipelines and modern data technologies; Snowflake or Databricks experience is preferred.

Qualifications

• Experience in Python, SQL, Spark and ETL pipelines.
• Hands-on with Kafka, Airflow and cloud platforms (Azure/AWS).
• Expertise in Snowflake/Databricks preferred.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Develop batch and streaming solutions with Kafka and Airflow.
• Manage cloud data platforms to ensure high-quality reliable data for analytics and AI use cases.

Skills

Python

SQL

Spark

Tools

Kafka

Airflow

Snowflake

Databricks

Azure

AWS

Job description

Design, build, and maintain scalable data pipelines using Python, SQL & Spark. Develop batch and streaming solutions with Kafka and Airflow. Manage cloud data platforms (Azure/AWS) & ensure high-quality reliable data for analytics and AI use cases.

Required Candidate profile

Experience in Python, SQL, Spark, and ETL pipelines. Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS). Expertise in Snowflake/Databricks preferred.