Snowflake Developer with DBT

Tata Consultancy Services; Chennai District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Tata Consultancy Services is seeking a data engineer in Chennai to build and optimize scalable data pipelines. You will source data from lakes, APIs, and on-prem systems, and transform and share data across cloud platforms with near real-time streaming capabilities.

You should be proficient in Snowflake, DBT, Python, PySpark, and SQL, and have hands-on experience with AWS. Experience with ELT tools like Fivetran and Matillion is a plus.

Qualifications

• Strong experience in Snowflake, DBT, Python, PySpark, and SQL.
• Expertise in developing scalable data pipelines, data transformations, data modelling, and cloud-based data engineering solutions.
• Experience with AWS platforms.

Responsibilities

• Source data from Data Lakes, APIs, and on-premises.
• Transform, replicate, and share data across cloud platforms.
• Design end-to-end near real-time streams.
• Design scalable compute solutions for Data Engineer workloads.
• Evaluate performance metrics.
• Proficient use of RESTful APIs and cloud-native concepts; handle semi-structured data.

Skills

Python

PySpark

SQL

Data pipelines

Cloud data engineering

Data modelling

Tools

Snowflake

Snowpark Python

DBT

Fivetran

Qlik Replicate

Matillion

AWS

Job description

JOB DESCRIPTION

• Source data from Data Lakes, APIs, and on-premises
• Transform, replicate, and share data across cloud platforms
• Strong experience in Snowflake, DBT, Python, PySpark, and SQL with expertise in developing scalable data pipelines, data transformations, data modelling, and cloud-based data engineering solutions.
• Design end-to-end near real-time streams
• Design scalable compute solutions for Data Engineer workloads
• Evaluate performance metrics
• Data engineering experience, including practical experience using Snowflake for
• Data Engineer tasks. In addition, successful candidates may have a working knowledge of Restful APIs, SQL, semi-structured datasets, and cloud native concepts.
• Have experience in AWS platforms.
• Experience in ELT tools Fivetran, Qlik replicate, Matillion,
• Experience with DBT
• Experience creating stored procedures, UDFs in Snowflake
• Experience in Snowpark python