Sr. Data Engineer

AMISEQ; Bengaluru; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

AMISEQ in Bengaluru is seeking a Senior Data Engineer with 6+ years of experience to design and optimize data pipelines. You will work with streaming tech like Kafka and Flink, and leverage Hadoop tools such as Hive, Iceberg, and Spark SQL to build scalable data solutions.

You will orchestrate workloads with Apache Airflow, write robust Python and SQL, and deploy in cloud-native environments using Docker and Kubernetes.

Qualifications

• 6+ years of relevant professional experience.
• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
• Extensive experience with streaming technologies like Kafka and Flink.
• Strong knowledge of Hadoop ecosystem tools such as Hive, Iceberg, Spark SQL.
• Experience with Apache Airflow for orchestrating data workflows and pipelines.
• Proficiency in Python, Unix/Linux, or similar technologies.
• Strong SQL skills, including experience with Oracle, SQL Server, or similar databases.
• Experience with graph databases such as Neo4j or JanusGraph and graph query languages.
• Experience with monitoring and CI/CD tools such as Prometheus, Grafana, Jenkins, and GitHub Actions.
• Strong engineering fundamentals, including data structures, algorithms, testing (JUnit/pytest), Git, and clean coding practices.
• Experience with cloud-native technologies, including Docker and Kubernetes (deployment, networking, scaling, and troubleshooting).
• 6+ years of relevant professional experience.
• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.

Skills

Analytical thinking

Problem solving

Team collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Apache Kafka

Apache Flink

Hive

Iceberg

Spark SQL

Apache Airflow

Python

Unix/Linux

Oracle/SQL Server

Neo4j

JanusGraph

Prometheus

Grafana

Jenkins

GitHub Actions

Docker

Kubernetes

JUnit/pytest

Git

Job description

• Extensive experience with Apache Kafka, Apache Flink, and other streaming technologies.
• Strong expertise in Hadoop ecosystem tools such as Hive, Iceberg, and Spark SQL.
• Good understanding of Apache Airflow for orchestrating complex data workflows and pipelines.
• Proven experience designing and implementing automated data pipelines and materialized views.
• Proficiency in Python, Unix/Linux, or similar technologies.
• Strong SQL skills, including experience with Oracle, SQL Server, or similar databases.
• Experience with graph databases such as Neo4j or JanusGraph and graph query languages.
• Experience with monitoring and CI/CD tools such as Prometheus, Grafana, Jenkins, and GitHub Actions.
• Strong engineering fundamentals, including data structures, algorithms, testing (JUnit/pytest), Git, and clean coding practices.
• Experience with cloud-native technologies, including Docker and Kubernetes (deployment, networking, scaling, and troubleshooting).
• 6+ years of relevant professional experience.
• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.