Data ETL Engineering Expert

Vega Intellisoft; Chennai District; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Vega Intellisoft in Chennai seeks an experienced Data Engineer to design, develop and maintain robust ETL/ELT data pipelines with a strong IDMC focus.

You will lead end-to-end data solution design, from source ingestion to reporting and APIs, while mentoring junior developers and enforcing best practices across ETL teams.

Hands-on experience with Snowflake, AWS or Azure, and DevOps CI/CD is highly valued; strong communication and collaboration are essential for success.

Qualifications

• Strong experience in solution design and architecture for enterprise data systems.
• Ability to handle large-scale, complex data environments with multiple integrations.
• Experience in stakeholder management and requirement gathering.
• Strong understanding of data governance, compliance, and security frameworks.
• Ability to mentor teams and lead technical discussions.
• Experience in performance optimization at scale.
• Excellent communication and collaboration skills.

Responsibilities

• Design, develop, test, deploy and maintain robust ETL/ELT data pipelines, with a strong focus on IDMC.
• Drive end-to-end data solution design from source ingestion to consumption layers.
• Mentor and guide junior developers, conduct code reviews, and enforce best practices.
• Design and implement data governance frameworks, including lineage tracking and metadata management.
• Design and enforce CI/CD pipelines and DevOps practices for ETL deployments.
• Coordinate with external operations teams and support deployment readiness.

Tools

Informatica IDMC

Snowflake

AWS

Azure

CI/CD tooling

Shell scripting

CDC streaming

Job description

What awaits you/ Job Profile

• Design, develop, test, deploy and maintain robust ETL/ELT data pipelines, with a strong focus on Informatica Intelligent Data Management Cloud (IDMC).
• Drive end-to-end data solution design, from source ingestion to consumption layers (reporting, analytics, APIs).
• Mentor and guide junior developers, conduct code reviews, and enforce best practices across ETL development.
• Design and implement data governance frameworks, including lineage tracking, metadata management, and data cataloging.
• Design and enforce CI/CD pipelines and DevOps practices for ETL deployments.
• Understanding deployment processes and system operations.
• Incident handling and environment stability.
• Coordination with external operations teams.
• Support in decommissioning, migration, and environment readiness.

What should you bring along

• Strong experience in solution design and architecture for enterprise data systems
• Ability to handle large-scale, complex data environments with multiple integrations
• Experience in stakeholder management and requirement gathering
• Strong understanding of data governance, compliance, and security frameworks
• Ability to mentor teams and lead technical discussions
• Experience in performance optimization at scale
• Excellent communication and collaboration skills.
• Domain background in Financial Services/banking.

Must have technical skill

• Expertise in IDMC services such as Data Integration, Data Quality, Cloud Data Governance, Catalog, mappings, transformations, workflows, performance tuning, scheduling, and production support.
• Advanced SQL and data modelling skills (views, mappings, historization).
• Strong experience with CDC implementations, Real-time/event-driven data pipelines.
• Hands-on experience with cloud data warehouses like Snowflake.
• Proficiency in shell scripting / automation.
• Experience implementing data validation reconciliation frameworks.
• Strong understanding of partitioning, indexing, and performance tuning techniques.
• Experience with job orchestration tools and workflow automation.
• Understanding SDLC, Agile methodologies, version control, and release processes.
• Develop technical documentation for Informatica configurations, scripts and procedures.
• Experience working on cloud platforms such as AWS or Azure.

Good to have skills

• Exposure to Python or Spark for data processing
• Knowledge of DevOps tools (Github, Jenkins, Terraform, etc.).