A data solutions company in Bengaluru is seeking a skilled data engineer to design and develop scalable data pipelines and platforms. The role requires strong experience with Python, PySpark, and SQL, along with familiarity with AWS and tools like Kafka and Airflow. The ideal candidate will focus on building batch and streaming solutions for enterprise data workloads while ensuring data quality and reliability. Experience with modern data architectures and tools like Snowflake and Glue is beneficial.
Qualifications
Strong experience with Python, PySpark, and SQL.
Hands-on experience with AWS, Kafka, and Airflow.
Understanding of lakehouse and modern data architectures.
Responsibilities
Design and develop scalable data pipelines and platforms.
Build batch and streaming solutions for enterprise data workloads.
Implement infrastructure using Terraform and cloud-native services.
Ensure data quality, performance, and reliability.
Skills
Python
PySpark
SQL
AWS
Kafka
Airflow
Tools
Terraform
Snowflake
DBT
Glue
Job description
Design and develop scalable data pipelines and platforms.
Build batch and streaming solutions for enterprise data workloads.
Implement infrastructure using Terraform and cloud-native services.
Ensure data quality, performance, and reliability.
Strong experience with Python, PySpark, SQL.
Hands‑on with AWS, Kafka, Airflow, Terraform.
Experience with Snowflake, DBT, Glue (good to have).
Understanding of lakehouse and modern data architectures.