Lead Snowflake Data Engineer

EPAM Systems; Gurugram District; Hybrid; INR 3,500,000 - 6,000,000; Full time

Job summary

EPAM Systems is seeking an experienced Lead Snowflake Data Engineer to design, build and maintain scalable data solutions on Snowflake. You will lead data pipelines, optimization, and governance across AWS/Azure, leveraging Cortex AI for advanced analytics.

The role requires extensive Snowflake experience, Python proficiency, and strong collaboration with data scientists to productionize ML models within Snowflake.

Qualifications

• 8 to 15 years of experience in data engineering focusing on cloud platforms.
• Hands-on Snowflake expertise including Snow SQL, Snow PLSQL and Snowpark.
• Strong Python programming for data engineering tasks.
• Experience with AWS and/or Azure cloud services.
• Experience with Airflow and DBT for orchestration and data modeling.
• Familiarity with Snowflake Cortex AI capabilities.

Responsibilities

• Design and implement robust data pipelines using Snowflake's native capabilities
• Develop and optimize complex queries using Snow SQL and Snow PLSQL
• Build scalable data applications with the Snowpark framework and Python
• Deploy and manage Snowflake environments across AWS and Azure cloud platforms
• Integrate Snowflake with various cloud services, data sources and governance frameworks
• Optimize cloud resource utilization and cost management
• Maintain data workflows using Apache Airflow and DBT for transformation pipelines
• Ensure data quality, reliability and performance across all pipelines
• Monitor and troubleshoot data pipeline issues
• Leverage Snowflake Cortex AI for advanced analytics and ML use cases
• Collaborate with data scientists to productionize ML models within Snowflake

Skills

Data engineering

Cloud data platforms

Python programming

Tools

Snowflake

Snow SQL

Snow PLSQL

Snowpark

AWS

Azure

Apache Airflow

DBT

Job description

We are seeking an experienced Lead Snowflake Data Engineer to join our data engineering team. The ideal candidate will be responsible for designing, developing and maintaining scalable data solutions using Snowflake's cloud data platform. This role requires expertise in modern data engineering practices, cloud technologies and AI/ML integration within the Snowflake ecosystem.

Responsibilities

• Design and implement robust data pipelines using Snowflake's native capabilities
• Develop and optimize complex queries using Snow SQL and Snow PLSQL
• Build scalable data applications with the Snowpark framework and Python
• Deploy and manage Snowflake environments across AWS and Azure cloud platforms
• Integrate Snowflake with various cloud services, data sources and governance frameworks
• Optimize cloud resource utilization and cost management
• Maintain data workflows using Apache Airflow and DBT for transformation pipelines
• Ensure data quality, reliability and performance across all pipelines
• Monitor and troubleshoot data pipeline issues
• Leverage Snowflake Cortex AI for advanced analytics and machine learning use cases
• Collaborate with data scientists to productionize ML models within Snowflake

Requirements

• 8 to 15 years of experience in data engineering with a focus on cloud-based data platforms
• 4+ years of hands-on expertise in Snowflake including Snow SQL, Snow PLSQL and Snowpark
• Proficiency in advanced Python programming for data engineering
• Skills in AWS and/or Azure cloud services
• Experience with Apache Airflow and DBT for workflow orchestration and data modeling
• Familiarity with Snowflake Cortex AI's native AI and ML capabilities