Snowflake Data Engineer

iSystems Ltd; Bengaluru; On-site; INR 2,800,000 - 5,200,000; Full time

Job summary

iSystems Ltd is seeking an experienced Data Engineer with strong Snowflake expertise to build scalable data pipelines and AI-powered solutions using Snowflake Cortex.

You will design and optimize ETL/ELT processes, implement RBAC and data governance, and collaborate with data scientists to deploy LLM-enabled analytics.

Qualifications

• 6+ years in data engineering with at least 3 years hands-on Snowflake experience.
• Strong SQL and Python for transformation and pipeline development.
• Hands-on experience with Snowpark, Snowpipe, Streams, Tasks, Dynamic Tables.
• Practical experience with Snowflake Cortex, including LLM functions, Cortex Search, or Cortex Analyst.
• Understanding of LLMs, embeddings, vector search, and Retrieval-Augmented Generation architectures.
• Experience designing data models, including dimensional modeling and medallion architecture.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT pipelines using SQL, Python, Snowpark, Snowpipe, Streams, Tasks, and Dynamic Tables.
• Develop and maintain data models to support analytics and AI workloads.
• Build AI-powered solutions using Snowflake Cortex LLM functions and Cortex tools for RAG and NL-to-SQL capabilities.
• Process and manage structured and unstructured data for analytics and AI applications.
• Develop interactive data apps using Streamlit within Snowflake.
• Monitor and optimize query performance, warehouse utilization, and overall costs; track AI token usage.
• Implement RBAC, data masking, security policies, and data governance practices.
• Establish CI/CD pipelines and version control using Git, dbt, Terraform.
• Implement data quality checks, monitoring, and validation for data reliability.

Skills

SQL

Python

Snowflake

LLMs

Data modeling

Analytics

Problem solving

Collaboration

Communication

Cloud fundamentals

Tools

Snowpark

Snowpipe

Streams

Tasks

Dynamic Tables

Snowflake Cortex

Cortex Search

Cortex Analyst

Git

Terraform

dbt

Job description

We are looking for an experienced Data Engineer with strong Snowflake expertise and hands-on experience developing AI-powered data solutions using Snowflake Cortex. The ideal candidate will be responsible for building scalable data pipelines, optimizing data processing and modeling, and integrating LLM capabilities into Snowflake to support advanced analytics and AI-driven applications.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT pipelines using SQL, Python, Snowpark, Snowpipe, Streams, Tasks, and Dynamic Tables.
• Develop and maintain data models, including dimensional modeling and medallion architecture, to support analytics and AI workloads.
• Build AI-powered solutions using Snowflake Cortex LLM functions, Cortex Search for Retrieval-Augmented Generation (RAG), and Cortex Analyst for natural language-to-SQL capabilities.
• Process and manage structured and unstructured data, including PDFs, images, and other document formats, for analytics and AI applications.
• Develop interactive data applications using Streamlit within Snowflake.
• Optimize query performance, warehouse utilization, and overall platform costs while monitoring AI and LLM token usage.
• Implement role-based access control (RBAC), data masking, security policies, and data governance practices.
• Establish CI/CD pipelines and version control practices using Git, dbt, Terraform, and related tools.
• Implement data quality checks, monitoring, and validation processes to ensure data accuracy, reliability, and consistency.
• Collaborate with business stakeholders, data scientists, and engineering teams to translate business requirements into scalable data and AI solutions.
• Provide technical guidance and mentorship to junior engineers while promoting engineering best practices.

Requirements

• 6+ years of experience in data engineering, including at least 3 years of hands-on experience with Snowflake.
• Strong proficiency in SQL and Python for data transformation, pipeline development, and data processing.
• Hands-on experience with Snowpark, Snowpipe, Streams, Tasks, and Dynamic Tables.
• Practical experience with Snowflake Cortex, including LLM functions, Cortex Search, or Cortex Analyst.
• Strong understanding of Large Language Models (LLMs), embeddings, vector search, and Retrieval-Augmented Generation (RAG) architectures.
• Experience designing and implementing data models, including dimensional modeling and medallion architecture.
• Familiarity with data orchestration tools such as Apache Airflow or equivalent platforms.
• Experience working with at least one major cloud platform: AWS, Microsoft Azure, or Google Cloud Platform (GCP).
• Working knowledge of Git, CI/CD practices, and infrastructure-as-code tools such as Terraform.
• Understanding of data security, access control, governance, and data quality management.
• Strong analytical, problem-solving, communication, and collaboration skills.