Snowflake Data Engineer (Blr/Pune/Hyd/BBSR/Chennai/Kochi)

Tata Consultancy Services Limited; Hyderabad, Pune District, Bengaluru; On-site; INR 2,600,000 - 4,200,000; Full time

Job summary

Tata Consultancy Services Limited is seeking a highly skilled Snowflake Data Engineer to design, build, and optimize scalable data pipelines across Snowflake, SQL, DBT, Snowpark Python, and ELT tools. You will source data from Data Lakes, APIs, and on-premises systems and enable near real-time processing across cloud environments.

The role emphasizes performance tuning, cloud-native architectures, and modern ELT frameworks.

Qualifications

• 7+ years of hands-on Snowflake Data Engineering experience.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Snowflake.
• Build enterprise-grade ELT workflows and data transformation frameworks.
• Source data from Data Lakes, APIs, and on-premises systems.
• Develop near real-time data processing and replication solutions.
• Implement reusable data ingestion and transformation patterns.
• Design and develop Snowflake-based data solutions.
• Create and optimize: Stored Procedures, UDFs, Snowflake Tasks, Views and Data Models.
• Work extensively with Snowpark Python for advanced transformations.
• Manage and optimize Snowflake compute resources for performance and cost efficiency.
• Develop and manage data integration solutions using Fivetran, Matillion, Qlik Replicate, DBT.
• Design data replication and synchronization processes.
• Support enterprise data migration and modernization initiatives.
• Work with cloud-native data platforms and modern data architectures.
• Transform, replicate, and share data across cloud environments.
• Support data lake integration and cloud data ecosystem initiatives.
• Assist in designing scalable compute solutions for large-scale workloads.
• Analyze and optimize data pipeline performance.
• Evaluate and improve workload efficiency and processing times.
• Monitor data quality, reliability, and operational performance.
• Implement best practices around scalability and maintainability.
• Work closely with architects, analysts, business stakeholders, and development teams.
• Participate in design discussions and technical reviews.
• Contribute to Agile delivery processes and sprint planning.
• Support production deployments and troubleshoot data pipeline issues.

Skills

Snowflake

SQL

Snowpark Python

DBT

ELT tools

AWS Cloud

REST APIs

Data Lakes

Cloud Native Architectures

Stored Procedures

UDFs

Data Pipelines

Near Real-Time Streams

Tools

Fivetran

Matillion

Qlik Replicate

DBT

Job description

We are seeking a highly skilled Snowflake Data Engineer with expertise in Snowflake, SQL, DBT, Snowpark Python, ELT tools, and AWS Cloud Services. The ideal candidate will be responsible for building scalable data engineering solutions, developing high-performance data pipelines, and enabling near real-time data processing across cloud platforms.

The role requires strong experience in Snowflake development, data transformation, API integrations, cloud-native architectures, and modern ELT frameworks.

Key Responsibilities

Data Engineering & Pipeline Development

• Design, develop, and maintain scalable data pipelines using Snowflake.
• Build enterprise-grade ELT workflows and data transformation frameworks.
• Source data from Data Lakes, APIs, and on-premises systems.
• Develop near real-time data processing and replication solutions.
• Implement reusable data ingestion and transformation patterns.

Snowflake Development

• Design and develop Snowflake-based data solutions.
  
• Create and optimize:
  
  • Stored Procedures
  • User Defined Functions (UDFs)
  • Snowflake Tasks
  • Views and Data Models
• Work extensively with Snowpark Python for advanced transformations.
  
• Manage and optimize Snowflake compute resources for performance and cost efficiency.
  

ELT & Data Integration

• Develop and manage data integration solutions using:
  
  • Fivetran
  • Qlik Replicate
  • Matillion
  • DBT
• Design data replication and synchronization processes.
  
• Support enterprise data migration and modernization initiatives.
  

Cloud & Data Platform Engineering

• Work with cloud-native data platforms and modern data architectures.
• Transform, replicate, and share data across cloud environments.
• Support data lake integration and cloud data ecosystem initiatives.
• Assist in designing scalable compute solutions for large-scale workloads.

Performance Optimization & Monitoring

• Analyze and optimize data pipeline performance.
• Evaluate and improve workload efficiency and processing times.
• Monitor data quality, reliability, and operational performance.
• Implement best practices around scalability and maintainability.

Collaboration & Delivery

• Work closely with architects, analysts, business stakeholders, and development teams.
• Participate in design discussions and technical reviews.
• Contribute to Agile delivery processes and sprint planning.
• Support production deployments and troubleshoot data pipeline issues.

Required Skills

• 7+ years of hands-on Snowflake Data Engineering experience.
  
• Strong expertise in:
  
  • Snowflake
  • SQL
  • Snowpark Python
  • DBT
• Experience with ELT tools:
  
  • Fivetran
  • Matillion
  • Qlik Replicate
• Strong knowledge of:
  
  • REST APIs
  • Semi-Structured Data
  • Data Lakes
  • Cloud Native Architectures
• Experience building:
  
  • Stored Procedures
  • UDFs
  • Data Pipelines
  • Near Real-Time Streams
• Strong understanding of performance optimization and workload tuning.
  

Preferred Skills

• AWS Cloud Services.
• Cloud Data Warehousing.
• Streaming and Event-Driven Architectures.
• Data Governance.
• Advanced Analytics Platforms.
• Performance Engineering.

Desired Candidate Profile

• Strong analytical and problem-solving skills.
• Excellent communication and stakeholder management abilities.
• Experience building scalable cloud data platforms.
• Ability to work independently and as part of distributed teams.
• Strong focus on performance, scalability, and data quality.
• Experience working in Agile development environments.