Data Specialist – R01569890

Brillio; Bengaluru; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Brillio in Bengaluru seeks a data integration engineer with 5–8 years of experience to design, develop, and maintain ETL/ELT pipelines using IICS and Snowflake.

You will build scalable data integration solutions, optimize workflows, and implement incremental loads with CDC and SCD patterns while collaborating with analysts and engineers to support production deployments.

Qualifications

• Hands-on experience with Informatica Intelligent Cloud Services (IICS) and Cloud Data Integration (CDI).
• Expertise in Snowflake data warehouse architecture (warehouses, stages, streams, tasks, time travel, zero-copy cloning).
• Advanced SQL development and query optimization.
• Proficiency in ETL/ELT development and data warehousing concepts.
• Experience developing mappings, mapping tasks, and taskflows in IICS.
• Implementation of parameterization and error handling in ETL pipelines.
• Scheduling and automation of data integration workflows.
• Design and management of incremental and full data loads including SCD and CDC patterns.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using IICS to support scalable data integration processes.
• Implement and optimize data integration workflows with CDI, ensuring robust error handling, scheduling, and parameterization.
• Develop complex mappings, tasks, and taskflows for efficient data movement and transformation.
• Build and maintain Snowflake data warehouse components to support analytics.
• Write and optimize advanced SQL queries and Snowflake stored procedures for high-performance processing.
• Implement data loading strategies from diverse sources into Snowflake, including incremental loads, CDC, and SCD Type 1/2.
• Perform data transformation, cleansing, validation, and reconciliation to ensure data quality and integrity.
• Troubleshoot ETL failures, data issues, and performance bottlenecks for reliable operations.
• Collaborate with BI, data architects, QA, and other teams to deliver end-to-end data solutions.

Skills

IICS

CDI

Snowflake

Advanced SQL

ETL/ELT

Parameterization

Scheduling

SCD/CD patterns

Education

Bachelor's degree in Computer Science / IT / Engineering

Snowflake Certification

Informatica Cloud Data Integration Certification

Tools

AWS

Azure

Git/Jenkins/Azure DevOps

Job description

With at least 5 to 8 years of experience designing, developing, and maintaining data integration and data warehouse solutions using IICS and Snowflake.

Key Responsibilities:

• 1. Design, develop, and maintain ETL/ELT pipelines using Informatica Intelligent Cloud Services (IICS) to support scalable data integration processes
• 2. Implement and optimize data integration workflows with IICS Cloud Data Integration (CDI), ensuring robust error handling, scheduling, and parameterization
• 3. Develop complex mappings, mapping tasks, taskflows, and reusable components for efficient data movement and transformation
• 4. Build and maintain Snowflake data warehouse solutions, including databases, schemas, tables, views, and stages to support business analytics
• 5. Write and optimize advanced SQL queries and Snowflake stored procedures to enable high-performance data processing and reporting
• 6. Implement data loading strategies from diverse source systems into Snowflake, including incremental loads, Change Data Capture (CDC), and Slowly Changing Dimensions (SCD) Type 1/Type 2
• 7. Perform data transformation, cleansing, validation, and reconciliation to ensure data quality and integrity
• 8. Troubleshoot ETL failures, data issues, and performance bottlenecks to ensure reliable data operations
• 9. Collaborate with business analysts, data architects, QA, and other technical teams to deliver end-to-end data solutions and support production deployments.

Required Skills:

• 1. Hands-on experience with Informatica Intelligent Cloud Services (IICS) and Cloud Data Integration (CDI)
• 2. Expertise in Snowflake data warehouse architecture and features including warehouses, stages, streams, tasks, time travel, and zero-copy cloning
• 3. Advanced SQL development and query optimization
• 4. Proficiency in ETL/ELT development and data warehousing concepts
• 5. Experience developing mappings, mapping tasks, and taskflows in IICS
• 6. Implementation of parameterization and error handling in ETL pipelines
• 7. Scheduling and automation of data integration workflows
• 8. Design and management of incremental and full data loads including SCD and CDC patterns.

Preferred Skills:

• 1. Experience with AWS or Azure cloud services for data integration and storage
• 2. Knowledge of AWS S3 or Azure Blob Storage for data ingestion
• 3. Familiarity with CI/CD and DevOps practices for ETL pipeline deployment
• 4. Proficiency in Python or scripting languages for automation
• 5. Experience with version control and automation tools such as Git, Jenkins, or Azure DevOps
• 6. Domain experience in Life Sciences or Pharmaceutical industry

Desired Qualifications:

• 1. Bachelor's degree in Computer Science, Information Technology, Engineering, or a closely related discipline
• 2. Certification in Snowflake or Informatica Cloud Data Integration (preferred)
• 3. Certification in AWS or Azure cloud platforms (preferred)