Data Analyst

Integel Institute Of Technology Tamil Nadu; Hyderabad, Chennai District, Bengaluru; Hybrid; INR 900,000 - 1,400,000; Full time

Job summary

Integel Institute Of Technology Tamil Nadu is seeking a Data Engineer to design, build, and optimize ETL/ELT pipelines for batch and real-time processing across data lakes and warehouses.

Ideal candidates have 3–8 years of experience and strong skills in SQL, Python, Spark, and cloud services, with hands-on experience in Airflow, Snowflake, Redshift, and BigQuery.

Qualifications

• Proficiency in SQL (advanced level).
• Python for data engineering tasks.

Responsibilities

• Design, build, and maintain ETL/ELT data pipelines for batch and real-time processing.
• Develop scalable data workflows using Python, SQL, PySpark/Spark SQL.
• Implement and manage data lakes and data warehouses (Snowflake, Redshift, BigQuery, Synapse).
• Integrate data from multiple sources using Airflow, ADF, Glue, or other orchestration tools.
• Ensure data quality, data validation, and governance across data assets.
• Optimize pipelines for performance, scalability, and cost efficiency.
• Work with big data frameworks like Hadoop, Hive, Spark, Kafka.
• Collaborate with Data Scientists, Analysts, Product Teams to deliver data solutions.
• Implement monitoring, logging, and alerting for pipelines and data platforms.
• Maintain and enhance database systems (PostgreSQL, MySQL, MongoDB, Cassandra).
• Ensure compliance with security, privacy, and industry data standards.

Skills

SQL

Python

Spark

Cloud services

Data modeling

Git

Kafka

Tools

Airflow

ADF

Glue

Snowflake

Redshift

BigQuery

Job description

Experience: 3 to 8 Years
Job Location: Hyderabad, Chennai, Bangalore
Employment Type: Full Time

Interview Mode: Virtual

Job Description:

We are hiring experienced professionals in Data Engineer. Candidates with 3 - 8 years of experience, strong analytical skills, and a passion for technology are encouraged to apply.

Roles & Responsibilities

• Design, build, and maintain ETL/ELT data pipelines for batch and real-time processing.
• Develop scalable data workflows using Python, SQL, PySpark/Spark SQL.
• Implement and manage data lakes and data warehouses (Snowflake, Redshift, BigQuery, Synapse).
• Integrate data from multiple sources using Airflow, ADF, Glue, or other orchestration tools.
• Ensure data quality, data validation, and governance across all data assets.
• Optimize data pipelines for performance, scalability, and cost efficiency.
• Work with big data frameworks like Hadoop, Hive, Spark, Kafka.
• Collaborate with Data Scientists, Analysts, Product Teams to deliver data solutions.
• Implement monitoring, logging, and alerting for pipelines and data platforms.
• Maintain and enhance database systems (PostgreSQL, MySQL, MongoDB, Cassandra).
• Ensure compliance with security, privacy, and industry data standards.

Required Skills

• Strong expertise in SQL (advanced level).
• Proficiency in Python for data engineering tasks.
• Experience with Apache Spark / PySpark.
• Hands-on with Airflow / ADF / Glue or similar tools.
• Experience with AWS / Azure / GCP cloud services.
• Knowledge of data modeling, schema design, and dimensional modeling.
• Experience with Snowflake / Redshift / BigQuery (any one).
• Knowledge of Kafka / Streaming technologies.
• Understanding of data lake / delta lake architecture.
• Version control: Git / GitLab / GitHub.