Senior Data Engineer - R01569889

Brillio 2; Bengaluru; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

Brillio is seeking a Senior Data Engineer to design, develop and maintain Snowflake-based data warehouses and ETL/ELT pipelines using IICS CDI. The role requires 5–8 years of experience and strong SQL/PLSQL skills.

You will work with data architects, QA, and analytics teams to deliver end-to-end data solutions and ensure high data quality and performance.

Qualifications

• Bachelor's degree in a relevant field is required.
• Snowflake or Informatica Cloud Data Integration certification is preferred.
• AWS or Azure cloud certifications are a plus.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using IICS to support scalable data integration.
• Implement and optimize data integration workflows with IICS CDI, ensuring robust error handling and scheduling.
• Develop complex mappings, mapping tasks, and taskflows for efficient data movement.
• Build and maintain Snowflake data warehouse solutions to support analytics.
• Write and optimize advanced SQL queries and Snowflake stored procedures for performance.
• Implement data loading strategies into Snowflake including CDC and SCD patterns.
• Transform, cleanse, validate, and reconcile data to ensure quality.
• Troubleshoot ETL failures and performance bottlenecks in data operations.
• Collaborate with analysts, architects, QA, and teams to deliver end-to-end solutions.

Skills

IICS & CDI

Snowflake engineering

Advanced SQL & DWH

ETL/ELT development

IICS mappings

Parameterization & error handling

Education

Bachelor's degree in CS/IT/Engineering

Snowflake or Informatica Cloud Data Integration cert

AWS or Azure cloud certs (preferred)

Tools

Informatica Cloud

Snowflake DWH

SQL & Stored Procedures

CI/CD basics

Python scripting

Git/Jenkins/Azure DevOps

Job description

Senior Data Engineer

DataStream, ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Time Travel and Fail Safe, Snowpipe, SnowSQL, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures

Snowflake Engineering: Senior Data Engineer

Experience Range

With at least 5 to 8 years of experience designing, developing, and maintaining data integration and data warehouse solutions using IICS and Snowflake

Key Responsibilities

• 1. Design, develop, and maintain ETL/ELT pipelines using Informatica Intelligent Cloud Services (IICS) to support scalable data integration processes
• 2. Implement and optimize data integration workflows with IICS Cloud Data Integration (CDI), ensuring robust error handling, scheduling, and parameterization
• 3. Develop complex mappings, mapping tasks, taskflows, and reusable components for efficient data movement and transformation
• 4. Build and maintain Snowflake data warehouse solutions, including databases, schemas, tables, views, and stages to support business analytics
• 5. Write and optimize advanced SQL queries and Snowflake stored procedures to enable high-performance data processing and reporting
• 6. Implement data loading strategies from diverse source systems into Snowflake, including incremental loads, Change Data Capture (CDC), and Slowly Changing Dimensions (SCD) Type 1/Type 2
• 7. Perform data transformation, cleansing, validation, and reconciliation to ensure data quality and integrity
• 8. Troubleshoot ETL failures, data issues, and performance bottlenecks to ensure reliable data operations
• 9. Collaborate with business analysts, data architects, QA, and other technical teams to deliver end-to-end data solutions and support production deployments

Required Skills

• 1. Hands-on experience with Informatica Intelligent Cloud Services (IICS) and Cloud Data Integration (CDI)
• 2. Expertise in Snowflake data warehouse architecture and features including warehouses, stages, streams, tasks, time travel, and zero-copy cloning
• 3. Advanced SQL development and query optimization
• 4. Proficiency in ETL/ELT development and data warehousing concepts
• 5. Experience developing mappings, mapping tasks, and taskflows in IICS
• 6. Implementation of parameterization and error handling in ETL pipelines
• 7. Scheduling and automation of data integration workflows
• 8. Design and management of incremental and full data loads including SCD and CDC patterns

Preferred Skills

• 1. Experience with AWS or Azure cloud services for data integration and storage
• 2. Knowledge of AWS S3 or Azure Blob Storage for data ingestion
• 3. Familiarity with CI/CD and DevOps practices for ETL pipeline deployment
• 4. Proficiency in Python or scripting languages for automation
• 5. Experience with version control and automation tools such as Git, Jenkins, or Azure DevOps
• 6. Domain experience in Life Sciences or Pharmaceutical industry

Desired Qualifications

• 1. Bachelor's degree in Computer Science, Information Technology, Engineering, or a closely related discipline
• 2. Certification in Snowflake or Informatica Cloud Data Integration (preferred)
• 3. Certification in AWS or Azure cloud platforms (preferred)