Data Engineer

Insight Global; Bengaluru; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Insight Global seeks a Snowflake Data Engineer to design, build and optimise data pipelines and cloud analytics environments within a large enterprise transformation. You will collaborate with stakeholders to enable advanced analytics, including AI/ML integrations, and drive performance improvements across the Snowflake platform.

The role requires on-site presence in Bengaluru three days a week and a strong background in Snowflake, SQL, Python, and data governance.

Qualifications

• Strong expertise in Snowflake data engineering and platform administration.
• Advanced SQL development experience, including ANSI SQL, stored procedures, and UDFs.
• Hands-on Snowflake Virtual Warehouses sizing, scaling and multi-cluster configs.
• Snowflake performance tuning via query tuning, clustering, caching and warehouse config.
• Knowledge of Streams and Tasks for real-time ingestion and workflow automation.
• Experience with Time Travel and Fail-Safe for data recovery and auditing.
• Experience building and maintaining ETL/ELT pipelines.
• Proficiency in Python for automation and data engineering workflows.
• Experience with Snowpark or in-database processing frameworks.
• Experience integrating Snowflake with Azure cloud services.
• Strong data warehousing concepts and dimensional modelling.
• Experience implementing data governance, RBAC, encryption and data sharing.

Responsibilities

• Design, build and optimise modern data pipelines and cloud analytics environments.
• Collaborate with stakeholders to support enterprise data initiatives and AI/ML integrations.
• Ensure platform performance and reliability with scalable Snowflake architectures.

Skills

Snowflake Engineering

ANSI SQL

Virtual Warehouses

Query Tuning

Streams & Tasks

Time Travel

ETL/ELT

Python

Snowpark

Azure Integration

RBAC & Security

CI/CD / DataOps

Tools

Azure

Snowflake

Python

Snowpark

Snowpipe

CI/CD

Job description

Insight Global are seeking a Snowflake Data Engineer for a large enterprise organisation undergoing a significant cloud and data transformation programme.

The successful candidate will be responsible for designing, building, and optimising modern data pipelines and cloud-based analytical environments. They will work closely with stakeholders across the business to support enterprise data initiatives, enhance platform performance, and enable advanced analytics capabilities, including AI/ML integrations.

This is permanent position with Insight Global and would require you to be onsite 3 days a week in the office in Bengaluru.

Must-Have Requirements Include:

• Strong expertise in Snowflake data engineering and platform administration.
• Advanced SQL development experience, including ANSI SQL, stored procedures, and user-defined functions.
• Hands-on experience building and managing Snowflake Virtual Warehouses, including sizing, scaling, and multi-cluster configurations.
• Experience optimising Snowflake performance through query tuning, clustering keys, caching strategies, and warehouse configuration.
• Knowledge of Snowflake Streams and Tasks for real-time ingestion, CDC processes, and workflow automation.
• Experience leveraging Snowflake Time Travel and Fail-Safe features for data recovery and auditing.
• Strong background building and maintaining ETL/ELT pipelines.
• Experience with Snowpipe for data ingestion and pipeline orchestration.
• Proficiency in Python for automation, scripting, and data engineering workflows.
• Hands-on experience with Snowpark or in-database processing frameworks.
• Experience integrating Snowflake with Azure cloud services.
• Strong understanding of data warehousing concepts and dimensional data modelling.
• Experience implementing data governance, security controls, RBAC, encryption, and secure data-sharing solutions.
• Familiarity with CI/CD pipelines and DevOps/DataOps practices supporting data engineering environments.

Plusses Include:

• Experience integrating Snowflake with AWS services and multi-cloud architectures.
• Exposure to Snowflake Cortex and AI/ML-driven analytics solutions.
• Knowledge of large language model (LLM) workflows and generative AI technologies.
• Experience developing automated deployment, testing, and environment management processes.
• Familiarity with enterprise-scale analytics, reporting, and business intelligence platforms.
• Experience supporting modern data platforms within highly regulated or large-scale enterprise environments.