Lead Engineer Support - IT

guardianlife; Chennai District; On-site; INR 700,000 - 1,000,000; Full time

Job summary

Guardian Life seeks a Data Ingestion and Integration Engineer to design, build, and optimize automated data pipelines for data ingestion and integration needs. This individual contributor role focuses on ETL development, production support, and collaboration with IT and business stakeholders.

The ideal candidate will have strong ETL knowledge, experience with Informatica PowerCenter/Cloud, and a solid grounding in SQL, Unix, and LakeHouse concepts.

Qualifications

• Proficient in ETL concepts and data integration.
• Strong knowledge of data analysis, data transformation, and metadata management.
• Experience with Informatica products and cloud ETL tools.
• Familiarity with SQL and Unix shell scripting.

Responsibilities

• Provide production support and on-call assistance for ETL platforms.
• Review data requirements for databases, apps, and reporting projects.
• Develop and enhance data systems and ETL workflows.
• Estimate tasks and participate in development planning.
• Assist in developing logical data models and data lineage.
• Monitor production jobs and resolve issues promptly.
• Collaborate with IT teams to improve processes.

Skills

ETL tools

Datalake/Databricks

Pyspark

SQL/Unix basics

LakeHouse concepts

Tools

Informatica PowerCenter

Informatica Cloud

Syncsort DMX-h

SSIS

Job description

Job Description:

Seeking a motivated Data Ingestion and Integration Engineer to join our team as an individual contributor.

In this role, resource will be responsible for primarily support and designing, building, and optimizing automated data pipelines to support data technology integration and ingestion needs.

Position Objective:

Informatica Platform Administration, Development & Production Support Review & analyze business data requirements working with IT and Business stake holders for Data warehousing, Data integration, Reporting projects.

Prepare Technical ETL design document, develop, & support ETL processes using Informatica Power center, Informatica Cloud, Syncsort DMX-h, & SSIS (SQL Server Integration Services) tools and production support 24/7 with on call support.

Competencies/Skills: Individual Contributor Competencies

Proficient in the following

• Any ETL tool knowledge (eg: Precisely/Informatica)
• Datalake/Databricks Concepts
• Pyspark
• SQL/Unix (basics)
• Strong Understanding of LakeHouse concepts (eg : Delta format ,Workflow creation etc)

Knowledge:

• Strong knowledge of ETL concepts especially as applied to Informatica, Informatica cloud.
• Strong knowledge of data analysis, data transformation, conceptual data modeling, data transformation &metadata management.
• Strong knowledge of data design for various applications.
• Strong knowledge of SQL.
• Good knowledge of various RDBMS, Mainframe
• Good knowledge of Project Life Cycles methodologies.
• Strong verbal & written communication skills.
• Strong knowledge of Unix & Unix Shell scripting
• Experience with Enterprise Scheduling tools such as Control-M is a plus.

Job responsibilities:

• Provide Production Support, on call support for all ETL platforms.
• Review & understand business data related ETL requirements for database, application and reporting projects.
• Develop & make enhancement on new & existing data systems.
• Participate in the development plans & resource estimation for task planning.
• Assist with the development of logical data models.
• Monitor production jobs & resolve any issues in a timely manner.
• Partner with other IT areas in resolving issues & improving processes
• Develop Informatica or ETL Workflows.
• Develop ETL code both in Informatica & at the shell script level.
• Design, build, and maintain automated data pipelines that ensure smooth data ingestion and integration from various sources.
• Develop scalable and efficient solutions for data ingestion, using best practices in ETL/ELT processes.
• Implement data validation and quality checks to ensure data integrity throughout the pipeline.
• Optimize data pipelines to handle large volumes of data in real-time and batch processing environments.
• Collaborate with data engineers, analysts, and other stakeholders to understand data requirements and deliver seamless solutions.
• Monitor pipeline performance, troubleshoot issues, and continuously improve pipeline efficiency.
• Document pipeline processes, configuration, and maintenance routines to facilitate knowledge sharing and onboarding.

Location:

This position can be based in any of the following locations: Chennai