Data Engineer

HelloEngineers; India; On-site; INR 1,200,000 - 2,400,000; Full time

Benefits offered by this job

Restaurant of client

Job summary

HelloEngineers is seeking a Data Engineer to design, build, and maintain scalable data pipelines and integration solutions. The candidate should have strong experience in SQL, Python, ETL processes, cloud platforms, and big data technologies.

You will design and optimize batch and real-time data processing, work with large datasets from multiple sources, and ensure data quality, security, and governance while collaborating with data analysts and business teams.

Qualifications

• Strong experience in Python and SQL.
• Hands-on experience with ETL tools and data pipelines.
• Experience with databases such as MySQL, PostgreSQL, Oracle, or SQL Server.
• Knowledge of Spark, Hadoop, or Kafka.
• Experience with cloud platforms such as AWS, Azure, or GCP.
• Familiarity with Snowflake, Redshift, or BigQuery.
• Experience with Airflow or similar workflow orchestration tools.
• Understanding of CI/CD and DevOps practices.

Responsibilities

• Design, develop, and maintain scalable ETL/data pipelines
• Build and optimize data architectures and data models
• Develop batch and real-time data processing solutions
• Work with large datasets from multiple sources
• Optimize SQL queries and database performance
• Collaborate with data analysts, data scientists, and business teams
• Ensure data quality, integrity, and security standards
• Support cloud-based data platforms and warehouse solutions
• Troubleshoot production issues and provide performance tuning

Skills

Python

SQL

ETL pipelines

Big data technologies

Cloud platforms

Airflow

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

MySQL

PostgreSQL

Oracle

SQL Server

Snowflake

Redshift

BigQuery

Spark

Hadoop

Kafka

Airflow

Docker

Kubernetes

Job description

Job Summary

We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and data integration solutions. The ideal candidate should have strong experience in SQL, Python, ETL processes, cloud platforms, and big data technologies.

Roles & Responsibilities

• Design, develop, and maintain scalable ETL/data pipelines
• Build and optimize data architectures and data models
• Develop batch and real-time data processing solutions
• Work with large datasets from multiple sources
• Optimize SQL queries and database performance
• Collaborate with data analysts, data scientists, and business teams
• Ensure data quality, integrity, and security standards
• Support cloud-based data platforms and warehouse solutions
• Troubleshoot production issues and provide performance tuning

Required Skills

• Strong experience in Python and SQL
• Hands‑on experience with ETL tools and data pipelines
• Experience with databases such as MySQL, PostgreSQL, Oracle, or SQL Server
• Knowledge of big data technologies like Spark, Hadoop, or Kafka
• Experience with cloud platforms such as AWS, Azure, or GCP
• Familiarity with Snowflake, Redshift, or BigQuery
• Experience with Airflow or similar workflow orchestration tools
• Understanding of CI/CD and DevOps practices

Preferred Skills

• Experience with data warehousing concepts
• Knowledge of REST APIs and data integration
• Familiarity with Docker/Kubernetes
• Good communication and problem‑solving skills

Education

Bachelor’s degree in Computer Science, Engineering, or related field.