Data Engineer

Tata Consultancy Services; Hyderabad; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

Tata Consultancy Services in Hyderabad is seeking a Snowflake Developer to build and optimize cloud data warehouses and pipelines. You will develop ELT processes using Snowpipe, Streams, and Tasks, and write advanced SQL queries and stored procedures to support large-scale analytics.

The role requires Python or Scala for automation and familiarity with cloud services (AWS/Azure/GCP) and tools like dbt, Fivetran, or Informatica. Strong focus on security and governance is essential.

Qualifications

• Experience with SQL and Snowflake SQL dialect for large data volumes.
• Proficiency in Python or Scala for automation and Snowpark development.
• Familiarity with ELT pipelines and cloud-based data warehousing concepts.

Responsibilities

• Data Pipeline Development: Build ELT processes to move data into Snowflake using Snowpipe/Streams/Tasks.
• SQL and Stored Procedures: Write advanced queries, views, and procedures to clean and analyze data.
• Performance Tuning: Monitor queries, optimize virtual warehouses, reduce costs.
• Data Modeling: Design scalable schemas and dimensional models for reporting.
• Security and Governance: Implement RBAC, data masking, and encryption for compliance.

Skills

SQL

SnowSQL

Python

Scala

Cloud platforms (AWS/Azure/GCP)

Tools

Snowpipe

Streams

Tasks

dbt

Fivetran

Informatica

Job description

A Snowflake Developer builds, optimizes, and manages cloud-based data warehouses and data pipelines using the Snowflake Data Cloud platform.

Core Responsibilities

• Data Pipeline Development: Build and maintain ELT (Extract, Load, Transform) processes to move data smoothly from source systems into Snowflake using tools like Snowpipe, Streams, and Tasks.
• SQL and Stored Procedures: Write advanced SQL queries, views, and stored procedures to clean, process, and analyze large volumes of data.
• Performance Tuning: Monitor query speeds, optimize resource use in virtual warehouses, and lower computing costs.
• Data Modeling: Design scalable database schemas, tables, and dimensional models tailored for business reporting.
• Security and Governance: Set up role-based access control (RBAC), data masking, and encryption to keep enterprise data safe and compliant.
• Data Migration: Move legacy databases and on-premises storage systems securely into the cloud environment.

Key Technical Skills

• Database Querying: Expert-level SQL and SnowSQL.
• Programming Languages: Python or Scala for automation and Snowpark development.
• Cloud & ETL Tools: Experience with cloud services (AWS, Azure, or GCP) and integration tools like dbt, Fivetran, or Informatica.
• Snowflake Features: Knowledge of Zero-Copy Cloning, Time Travel, and secure data sharing.