Data Engineer Snowflake

AlgoLeap Technologies Pvt Ltd.; Hyderabad; On-site; INR 900,000 - 1,400,000; Full time

Job summary

AlgoLeap Technologies Pvt Ltd in Hyderabad is seeking a data engineer to design and deploy scalable data pipelines using Snowflake and Python. You will optimize ETL workflows, write complex SQL, and collaborate with data architects and analysts to deliver trusted analytics.

The role involves Snowflake performance tuning, cost management, data security, and production support. Proficiency with Snowpipe, Streams, Stages, and cloud-storage integration is needed.

Responsibilities

• Design and develop scalable data pipelines and ETL/ELT workflows.
• Develop and optimize data solutions using Snowflake.
• Write complex and optimized SQL queries for data transformation and analysis.
• Develop data ingestion pipelines from multiple structured and unstructured sources.
• Implement data extraction, transformation, loading, and validation processes.
• Work with Python for data processing and automation.
• Design data models, schemas, tables, views, and stored procedures in Snowflake.
• Implement Snowflake performance optimization and cost-management techniques.
• Work with Snowflake Streams, Tasks, Stages, Snowpipe, and Dynamic Tables.
• Integrate Snowflake with cloud storage and other enterprise applications.
• Monitor data pipelines and troubleshoot data quality/performance issues.
• Implement data security, access controls, and governance.
• Collaborate with Data Architects, Analysts, BI teams, and business stakeholders.
• Participate in code reviews, testing, deployment, and production support.

Tools

Snowflake

SQL

Python

ETL/ELT

Snowpipe

Job description

Job Description:

Key Responsibilities

• Design and develop scalable data pipelines and ETL/ELT workflows.
• Develop and optimize data solutions using Snowflake.
• Write complex and optimized SQL queries for data transformation and analysis.
• Develop data ingestion pipelines from multiple structured and unstructured sources.
• Implement data extraction, transformation, loading, and validation processes.
• Work with Python for data processing and automation.
• Design data models, schemas, tables, views, and stored procedures in Snowflake.
• Implement Snowflake performance optimization and cost-management techniques.
• Work with Snowflake Streams, Tasks, Stages, Snowpipe, and Dynamic Tables.
• Integrate Snowflake with cloud storage and other enterprise applications.
• Monitor data pipelines and troubleshoot data quality/performance issues.
• Implement data security, access controls, and governance.
• Collaborate with Data Architects, Analysts, BI teams, and business stakeholders.
• Participate in code reviews, testing, deployment, and production support.

Requirements: