Data Engineer

Blackstraw Technologies; Chennai District; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Blackstraw Technologies is seeking a data engineer to design, build and maintain data pipelines for Data Science teams in Chennai. The role focuses on ETL processes, Spark-based pipelines and SQL-driven data modeling, with exposure to cloud platforms.

The candidate should be comfortable with Unix/Linux, shell scripting, and will benefit from hands-on experience with Hive, Airflow, Impala and Hadoop ecosystem. Kubernetes and Kafka exposure are a plus.

Responsibilities

• Participate in customer discussions to understand functional and technical requirements.
• Design, build, and maintain data pipelines for Data Science teams.
• Strong SQL query writing and query tuning skills.
• Experience with Unix/Linux and Shell Scripting.
• Knowledge of Cloud platforms (AWS/Azure/GCP) is an added advantage.
• Good to have exposure to Kubernetes, CI/CD, and Apache Kafka.

Skills

ETL

Python

SQL

Unix/Linux

Shell scripting

Cloud platforms

query tuning

Tools

PySpark/Spark

Scala

Hadoop ecosystem

Hive

Airflow

Impala

RDBMS

Kubernetes

CI/CD

Apache Kafka

Job description

Key Responsibilities & Requirements

• Participate in customer discussions to understand functional and technical requirements.
• Design, build, and maintain data pipelines for Data Science teams.
• Strong experience in ETL, Python, PySpark/Spark, Scala, SQL, and Hadoop ecosystem.
• Hands‑on experience with Hive, Airflow, Impala, and RDBMS.
• Strong SQL query writing and query tuning skills.
• Experience with Unix/Linux and Shell Scripting.
• Knowledge of Cloud platforms (AWS/Azure/GCP) is an added advantage.
• Good to have exposure to Kubernetes, CI/CD, and Apache Kafka.