Data Engineer

Algoleap Technologies; Bengaluru; On-site; INR 2,400,000 - 4,500,000; Full time

Job summary

Algoleap Technologies is seeking a senior Data Engineer to design, build, and optimize ETL/ELT pipelines for batch and streaming data. You will develop data warehouses and lakes using Snowflake, BigQuery, and Redshift, and collaborate with data scientists, analysts, and product teams to translate data needs into robust solutions.

Join a hands-on team that emphasizes data quality, observability, and scalable architectures.

Qualifications

• 5+ years of experience in data engineering or related role.
• Proficiency in SQL and Python (or Scala/Java).
• Experience with cloud platforms (AWS, GCP, or Azure).
• Hands-on with big data tools: Spark, Kafka, or dbt.
• Familiarity with data warehousing concepts and dimensional modeling.
• Strong understanding of CI/CD and version control (Git).

Responsibilities

• Design, build, and optimize ETL/ELT pipelines for batch and streaming data.
• Develop and maintain data warehouses and data lakes (Snowflake, BigQuery, Redshift).
• Collaborate with data scientists, analysts, and product teams to understand data needs.
• Ensure data quality, reliability, and observability across pipelines.
• Build and manage orchestration workflows (Airflow, Prefect, Dagster).
• Implement best practices for data modeling, partitioning, and performance tuning.
• Monitor and troubleshoot data infrastructure issues in production.

Skills

SQL

Python

Scala/Java

Cloud platforms

Big data

CI/CD

Git

Tools

Airflow

Prefect

Dagster

Snowflake

BigQuery

Redshift

dbt

Spark

Kafka

Job description

Algoleap Technologies Pvt Ltd | Full time

Responsibilities

• Design, build, and optimize ETL/ELT pipelines for batch and streaming data
• Develop and maintain data warehouses and data lakes (e.g., Snowflake, BigQuery, Redshift)
• Collaborate with data scientists, analysts, and product teams to understand data needs
• Ensure data quality, reliability, and observability across pipelines
• Build and manage orchestration workflows (e.g., Airflow, Prefect, Dagster)
• Implement best practices for data modeling, partitioning, and performance tuning
• Monitor and troubleshoot data infrastructure issues in production

Requirements

• 5+ years of experience in data engineering or a related role
• Proficiency in SQL and Python (or Scala/Java)
• Experience with cloud platforms (AWS, GCP, or Azure)
• Hands-on with big data tools: Spark, Kafka, dbt, or similar
• Familiarity with data warehousing concepts and dimensional modeling
• Strong understanding of CI/CD and version control (Git)

Nice to Have

• Experience with real-time/streaming pipelines (Kafka, Flink, Kinesis)
• Exposure to ML pipelines or MLOps tooling
• Knowledge of data governance and data catalog tools (e.g., Atlan, Alation)