Data Engineer / Big Data Engineer / Cloud Data Engineer

Consult Asia; Surat; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Consult Asia in Surat, India is seeking a data engineer to design, build, and maintain scalable data pipelines using Python, SQL and Spark. You will work on end-to-end data solutions across batch and streaming architectures.

Responsibilities include developing Kafka and Airflow workflows, and managing cloud data platforms on Azure and AWS to ensure high-quality, reliable data for analytics and AI use cases.

Qualifications

• Experience in Python, SQL, Spark and ETL pipelines.
• Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS).
• Snowflake or Databricks expertise preferred.

Responsibilities

• Design, build, and maintain scalable data pipelines using Python, SQL & Spark.
• Develop batch and streaming solutions with Kafka and Airflow.
• Manage cloud data platforms (Azure/AWS) and ensure high-quality reliable data for analytics and AI use cases.

Skills

Python

SQL

Spark

ETL pipelines

Kafka

Airflow

Tools

Snowflake

Databricks

Azure

AWS

Job description

Design, build, and maintain scalable data pipelines using Python, SQL & Spark. Develop batch and streaming solutions with Kafka and Airflow. Manage cloud data platforms (Azure/AWS) & ensure high-quality reliable data for analytics and AI use cases.

Required Candidate profile

Experience in Python, SQL, Spark, and ETL pipelines. Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS). Expertise in Snowflake/Databricks preferred.