Data Engineer / Big Data Engineer / Cloud Data Engineer

Consult Asia; Ernakulam; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Consult Asia is seeking a data engineer to design, build, and maintain scalable data pipelines using Python, SQL, and Spark. You will implement batch and streaming solutions with Kafka and Airflow, and manage cloud data platforms on Azure and AWS to support analytics and AI use cases.

Experience with Snowflake and Databricks is preferred. The role involves delivering reliable data for analytics, ensuring data quality, and collaborating with teams across the organization.

Qualifications

• Experience in Python, SQL, Spark, and ETL pipelines.
• Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS).
• Expertise in Snowflake/Databricks preferred.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Develop batch and streaming solutions with Kafka and Airflow.
• Manage cloud data platforms and ensure high-quality data for analytics and AI use cases.

Skills

Python

SQL

Spark

ETL pipelines

Kafka

Airflow

Azure

AWS

Tools

Snowflake

Databricks

Job description

Design, build, and maintain scalable data pipelines using Python, SQL & Spark. Develop batch and streaming solutions with Kafka and Airflow. Manage cloud data platforms (Azure/AWS) & ensure high-quality reliable data for analytics and AI use cases.

Required Candidate profile

Experience in Python, SQL, Spark, and ETL pipelines. Hands-on with Kafka, Airflow, and cloud platforms (Azure/AWS). Expertise in Snowflake/Databricks preferred.