Snowflake + DBT - Data Engineer

Tiger Analytics; Hyderabad, Chennai, Bengaluru; Hybrid; INR 1,500,000 - 2,300,000; Full time

Job summary

Tiger Analytics seeks an experienced data engineering professional to lead end-to-end data architecture and migration projects. You will design scalable data models, select appropriate stacks, and collaborate with clients, data engineers, and data scientists to implement robust data strategies.

Applicants should have 4-9 years of experience with Snowflake, Python, PySpark, and cloud environments (Azure/AWS/GCP). Strong SQL skills and data governance are essential.

Qualifications

• 4-9 years of relevant experience.
• Experience in SnowPro/ Python/ PySpark.
• Migration projects from On-prem to Snowflake.
• Snowflake capabilities like SnowPipe, SnowSQL, Streams, architecture.
• Data migration from RDBMS to Snowflake cloud data warehouse.
• Incremental extraction loads - batched and streaming.
• Experience with Azure, AWS or GCP.
• Strong data modelling, data access patterns and SQL.

Responsibilities

• Collaborate with clients to understand requirements.
• Design end-to-end data architectures and data strategy.
• Identify technology stacks and tools to meet requirements.
• Define data sources, storage, pipelines, security policies.
• Work with data engineers and scientists to execute strategy.
• Own end-to-end delivery and monitor milestones.
• Participate in UAT and address client issues.
• Mentor team members and contribute technical artifacts.
• Guide DevOps for CI/CD processes.

Skills

Python

PySpark

SQL

Data modelling

Data governance

Tools

Snowflake

SnowSQL

Snowpipe

Streams

Job description

Role & responsibilities

On a typical day, you might

• Collaborate with the clients to understand the overall requirements
• Create a robust, extensible architecture to meet the client/business requirements
• Translate the Business requirements into technical artifacts
• Identify the right technology stack and tools that best meet the client requirements
• Design end to end solutions along with data strategy, including standards, principles, data sources, storage, pipelines, data flow, and data security policies
• Collaborate with data engineers, data scientists, and other stakeholders to execute the data strategy
• Perform data analysis to understand the relevant data sets
• Design and create Data Models to cater to all the requirements
• Identify and implement the right orchestration tool
• Define the right security and access policies
• Implement the Snowflake best practices
• Define the right data distribution/consumption pattern for downstream systems and consumers
• Perform the code reviews and ensure quality deliverables
• Work with DevOps team to define and establish CI/CD process
• Own end-to-end delivery of the project
• Work closely with the clients during UAT Testing and ensure all client issues/concerns are addressed
• Proactively identify the performance bottlenecks and propose corrective actions
• Design and Develop reusable frameworks
• Work with the Project Managers to prioritize work for each sprint to meet project milestones and deadlines
• Closely monitor the Project progress and provide regular updates to the leadership teams on the milestones, impediments etc
• Guide /mentor team members, and create the technical artifacts
• Demonstrate thought leadership

Preferred candidate profile

• 4-9 years of relevant experience.
• Work from our Chennai (white space) office all 5 days a week to handle sensitive data
• Experience in Snowpro/ Python/ Pyspark
• Decent experience in migration projects, migrating from On-prem to Snowflake
• Comprehensive knowledge of the Snowflake capabilities such as Snow pipe, SnowSQL, Streams, and Snowflake architecture and awareness of Snowflake roles and user security.
• In-depth knowledge and experience in data migration from RDBMS to Snowflake cloud data warehouse
• Well-versed with Incremental extraction loads - batched and streaming
• Experience with Azure, AWS, or GCP
• Ability to architect data architecture solutions that are in alignment with the strategic technology roadmap and emerging industry trends
• Strong exposure to Data Modelling, Data Access Patterns, and SQL
• Knowledge of Cost Management, Infrastructure Planning & Disaster Recovery
• Good experience in Data Governance and a good understanding of DevOps practices
• Understanding of Data Virtualization
• Experience in working in Big Data Platform
• Ability to work closely with cross-functional teams
• Excellent communication (verbal and written) and excellent interpersonal skills.