Lead Snowflake Data Engineer

EPAM Systems; Hyderabad; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

EPAM Systems in Hyderabad seeks an experienced Lead Snowflake Data Engineer to design, develop and maintain scalable data solutions on Snowflake Cloud Data Platform, with focus on cloud-native data engineering, AI/ML integration within Snowflake.

You will collaborate with data scientists to productionize ML models, build pipelines with Snowpark and Python, and deploy on AWS/Azure while optimizing costs and ensuring data quality and performance.

Qualifications

• 8 to 15 years of experience in data engineering with a focus on cloud-based data platforms.
• 4+ years of hands-on expertise in Snowflake including Snow SQL, Snow PLSQL and Snowpark.
• Proficiency in Python programming for data engineering.
• Skills in AWS and/or Azure cloud services.
• Experience with Airflow and DBT for workflow orchestration and data modeling.
• Familiarity with Snowflake Cortex AI native AI/ML capabilities.

Responsibilities

• Design and implement robust data pipelines using Snowflake's native capabilities.
• Develop and optimize complex queries using Snow SQL and Snow PLSQL.
• Build scalable data applications with the Snowpark framework and Python.
• Deploy and manage Snowflake environments across AWS and Azure cloud platforms.
• Integrate Snowflake with various cloud services, data sources and governance frameworks.
• Maintain data workflows using Apache Airflow and DBT for transformation pipelines.
• Ensure data quality, reliability and performance across all pipelines.

Skills

Snowflake

Snow SQL

Snow PLSQL

Snowpark

Python

AWS/Azure

Airflow

DBT

Snowflake Cortex AI

Tools

Airflow

DBT

Snowpark

Snowflake Cortex AI

Job description

We are seeking an experienced Lead Snowflake Data Engineer to join our data engineering team. The ideal candidate will be responsible for designing, developing and maintaining scalable data solutions using Snowflake's cloud data platform. This role requires expertise in modern data engineering practices, cloud technologies and AI/ML integration within the Snowflake ecosystem.

Responsibilities

• Design and implement robust data pipelines using Snowflake's native capabilities
• Develop and optimize complex queries using Snow SQL and Snow PLSQL
• Build scalable data applications with the Snowpark framework and Python
• Deploy and manage Snowflake environments across AWS and Azure cloud platforms
• Integrate Snowflake with various cloud services, data sources and governance frameworks
• Optimize cloud resource utilization and cost management
• Maintain data workflows using Apache Airflow and DBT for transformation pipelines
• Ensure data quality, reliability and performance across all pipelines
• Monitor and troubleshoot data pipeline issues
• Leverage Snowflake Cortex AI for advanced analytics and machine learning use cases
• Collaborate with data scientists to productionize ML models within Snowflake

Requirements

• 8 to 15 years of experience in data engineering with a focus on cloud-based data platforms
• 4+ years of hands-on expertise in Snowflake including Snow SQL, Snow PLSQL and Snowpark
• Proficiency in advanced Python programming for data engineering
• Skills in AWS and/or Azure cloud services
• Experience with Apache Airflow and DBT for workflow orchestration and data modeling
• Familiarity with Snowflake Cortex AI's native AI and ML capabilities