Snowflake Data Engineer - Lead

NITYO; Bengaluru; On-site; INR 2,800,000 - 4,200,000; Full time

Job summary

NITYO is seeking a Snowflake Data Engineer - Lead in Bengaluru, India to head Snowflake Data Warehouse development, SQL optimization, and data integration projects. You will design data loading solutions using COPY INTO, Snowpipe, and stages, implement CDC with Snowflake Streams, and automate pipelines with Snowflake Tasks. Collaboration with AWS Glue and S3 will be key.

The role requires leadership in performance tuning, troubleshooting, and cross-team communication in a hybrid work setting.

Qualifications

• Must-have: Snowflake Data Warehouse experience, advanced SQL, COPY INTO, Snowpipe, internal and external stages, Snowflake Streams, AWS integration, AWS Glue ETL, performance tuning & troubleshooting.
• Desirable: Snowflake External Tables, AWS Step Functions, strong collaboration and communication skills.

Responsibilities

• Lead Snowflake Data Warehouse development and SQL optimization.
• Design and implement data loading solutions with COPY INTO, Snowpipe, and stages.
• Manage CDC with Snowflake Streams and automate pipelines using Snowflake Tasks.
• Integrate Snowflake with AWS services including S3 and Glue; develop Glue jobs in Python/PySpark.
• Monitor and optimize query performance and warehouse utilization.
• Troubleshoot ETL pipelines and cross-platform data integration issues.

Skills

Snowflake Data Warehouse

Advanced SQL

Snowflake Streams

COPY INTO

Snowpipe

AWS Glue

Performance tuning

Troubleshooting

Python/PySpark

Tools

Snowpipe

Snowflake Stages

AWS Glue

AWS Step Functions

Amazon S3

Job description

Snowflake Data Engineer - Lead

This role involves leading Snowflake Data Warehouse & SQL development, data ingestion and integration, CDC & pipeline automation, AWS integration, and external tables & data access.

Key Responsibilities

• Develop and optimize complex SQL queries, including joins, aggregations, window functions, and stored procedures
• Support Snowflake Data Warehouse development, maintenance, and performance optimization
• Design and implement data loading solutions using COPY INTO, Snowpipe, and Snowflake stages
• Manage internal and external stages for efficient data ingestion and processing
• Implement Change Data Capture (CDC) solutions using Snowflake Streams
• Automate data pipelines and workflows using Snowflake Tasks
• Integrate Snowflake with AWS services, including Amazon S3 and AWS Glue
• Create and manage Snowflake External Tables for querying data directly from Amazon S3
• Support Data Lake integration and external data access requirements
• Build and maintain ETL pipelines using AWS Glue
• Develop and support Python/PySpark-based Glue jobs for data transformation and processing
• Design and manage workflow automation using AWS Step Functions
• Implement state machines, job sequencing, dependency management, and error handling
• Monitor and optimize Snowflake query performance and warehouse utilization
• Troubleshoot ETL pipelines, data loading processes, and integration issues across Snowflake and AWS platforms

Requirements

• Must-haves: Snowflake Data Warehouse experience, advanced SQL development skills, experience with COPY INTO, Snowpipe, internal and external stages, Snowflake Streams, AWS integration, AWS Glue ETL, and performance tuning & troubleshooting
• Desirable: experience with Snowflake External Tables, AWS Step Functions, and collaboration & communication skills

Work Arrangements

• Work schedule: 9 AM to 6 PM
• Remote work: Hybrid (Face to Face, WFO / WFH)
• Office visits: Not specified
• Travel requirements: Not specified