Data Engineer-(IDMC+Snowflake+SQL)

Excelencia iTech Consulting; Chennai District; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Chennai City Corporation in India is seeking a data integration specialist with 5–7 years of experience to develop, maintain, and optimize data pipelines, and to support data warehousing and BI architectures.

The role requires hands-on work with ETL/ELT tools, cloud data platforms and big data technologies, plus collaboration with cross-functional teams to deliver scalable, secure data solutions and timely data insights for municipal operations.

Qualifications

• Advanced SQL knowledge and experience with relational databases.
• Experience with ETL/ELT, data warehousing, and BI architectures.
• Experience building scalable data pipelines and data integration.
• Familiarity with AI/ML frameworks is a plus.

Responsibilities

• Develop, maintain, and enhance data pipelines (ETL/ELT) and processes.
• Hands-on experience with PowerCenter, IDMC/IICS.
• Troubleshoot DW production data issues and optimize queries.
• Design data models and implement data security.
• Collaborate with cross-functional teams in a dynamic environment.

Skills

Advanced SQL

Data Pipelines

Python

Java

Scala

C++

Big Data

Analytical skills

Agile methodologies

Cross-functional teamwork

Project management

Data security

Tools

PowerCenter

IDMC/IICS

Kafka

Spark

Hadoop

Snowflake

Databricks

Redshift

BigQuery

MS Synapse

MS ADLS

Java

Python

Scala

C++

Job description

Chennai City Corporation, India | Posted on 10/07/2026

Location:Pune/Hybrid

Experience:Min 5 to 7 Years

• Development, maintenance, and enhancement of Data Pipelines (ETL/ELT) and processes with thorough knowledge of star/snowflake schemas
  
• Hands on experience in PowerCenter Developer/IDMC/IICS Data Integration
  
• Experience in DW Production Support / troubleshooting data or pipeline issues
  
• Developing complex SQL queries and SQL optimization
  
• Development experience must be full Life Cycle experience including business requirements gathering, data sourcing, testing/data reconciliation, and deployment within Business Intelligence/Data Warehousing Architecture.
  
• Designing and implementing data security
  
• Monitoring and optimizing data storage and data processing
  
• Use of Object function/object-oriented scripting languages including Scala, C++, Java and Python
  
• Cloud data warehouse and data lake platforms (e.g., Snowflake, Databricks, Redshift, BigQuery, MS Synapse, MS ADLS, Apache Haddop, etc.)
  
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
  
• Strong project management and organizational skills.
  
• Experience supporting and working with cross-functional teams in a dynamic environment.
  
• Understanding of data science concepts
  
• Familiarity with AI/ML frameworks and libraries

Requirements

• Developing data services that are fit for purpose, resilient, scalable, and future proof, to meet user needs
  
• Advanced SQL knowledge and experience working with relational databases and working familiarity with various databases.
  
• Demonstrated understanding and experience using software and tools including ETL, relational SQL and NoSQL databases, big data tools like Kafka, Spark, and Hadoop
  
• Experience building and optimizing ‘big data’ data pipelines, architecture, and data sets.
  
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  
• Strong analytic skills related to working with unstructured datasets.
  
• Experience and knowledge of project management best practices and agile software development methodologies
  
• A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
  
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
  
• Strong project management and organizational skills.
  
• Experience supporting and working with cross-functional teams in a dynamic environment.
  
• Understanding of data science concepts
  
• Familiarity with AI/ML frameworks and libraries