Data Engineer / Big Data Engineer / Cloud Data Engineer

Consult Asia; Greater Noida; On-site; INR 900,000 - 1,400,000; Full time

Job summary

Consult Asia is seeking a data engineering professional to design, build, and scale data pipelines using Python, SQL and Spark. You will implement batch and streaming solutions with Kafka and Airflow, and manage cloud data platforms on Azure and AWS to deliver high-quality data for analytics and AI use cases.

Candidates should be hands-on with Python, SQL, Spark and ETL pipelines, plus experience with Kafka, Airflow and cloud platforms (Azure/AWS). Snowflake or Databricks expertise is preferred.

Qualifications

• Hands-on experience with Python, SQL, Spark and ETL pipelines.
• Proficiency with Kafka, Airflow and cloud platforms (Azure/AWS).
• Experience with Snowflake or Databricks is preferred.

Responsibilities

• Design, build, and maintain scalable data pipelines using Python, SQL & Spark.
• Develop batch and streaming solutions with Kafka and Airflow.
• Manage cloud data platforms (Azure/AWS) and ensure high-quality data for analytics and AI use cases.

Skills

Python

SQL

Spark

Kafka

Airflow

ETL

Tools

Snowflake

Databricks

Azure

AWS

Job description

Design, build, and maintain scalable data pipelines using Python, SQL & Spark. Develop batch and streaming solutions with Kafka and Airflow. Manage cloud data platforms (Azure/AWS) & ensure high-quality reliable data for analytics and AI use cases.

Required Candidate profile

Experience in Python, SQL, Spark, and ETL pipelines. Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS). Expertise in Snowflake/Databricks preferred.