Senior Snowflake Data Engineer

Luxoft; Bengaluru; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Luxoft in Bengaluru seeks a Senior Snowflake Developer/Architect to design, develop, and maintain scalable data solutions that enable reporting, analytics, and AI-driven insights. You will own the technical implementation of data flows, repositories, and data-centric solutions within a Snowflake-centric stack.

The role emphasizes Snowflake architecture, DBT pipelines, Fivetran ingestion, Python-driven processing, and CI/CD using Azure DevOps to deliver robust data platforms with strong quality

Qualifications

• Master's degree in computer science, information technology, or related field.
• 8 years of data engineering experience with 5–6 years in Snowflake and DBT.
• Experience using Fivetran for automated ELT ingestion and integrating with DBT & Snowflake.

Responsibilities

• Implement data modelling techniques (OLTP, OLAP, Data Vault 2.0).
• Write optimized SQL for data extraction, transformation, and loading.
• Use Python for data processing, automation, and integration.
• Advise on Snowflake architecture, features, and best practices.
• Develop and maintain complex data pipelines and ETL in Snowflake.
• Collaborate with architects, analysts, and stakeholders for scalable solutions.
• Automate DBT jobs and build CI/CD pipelines using Azure DevOps.
• Ensure data quality, integrity, and compliance across the lifecycle.
• Troubleshoot and optimize data processes for performance.
• Document data models and workflows for knowledge sharing.
• Build data tests and mock data frameworks.

Skills

Snowflake

DBT

Python

SQL

Data modelling

OLTP/OLAP

CI/CD

Azure DevOps

Fivetran

Communication

Education

Master's degree in computer science or related field

Tools

Snowflake

DBT

Fivetran

Azure DevOps

Python

SQL

Job description

Project description

The project is for one of the world's famous science and technology companies in pharmaceutical industry, supporting initiatives in AWS, AI and data engineering, with plans to launch over 20 additional initiatives in the future. Modernizing the data infrastructure through the transition to Snowflake as a priority, as it will enhance capabilities for implementing advanced AI solutions and unlock numerous opportunities for innovation and growth.We are seeking a Senior Snowflake Developer/Architect will be responsible for designing, developing, and maintaining scalable data solutions that effectively meet the needs of our organisation.The role will serve as a primary point of accountability for the technical implementation of the data flows, repositories and data-centric solutions in your area, translating requirements into efficient implementations. The data repositories, data flows and data-centric solutions you create will support a wide range of reporting, analytics, decision support and (Generative) AI solutions.

Responsibilities

• Implement and manage data modelling techniques, including OLTP, OLAP, and Data Vault 2.0 methodologies.
• Write optimised SQL queries for data extraction, transformation, and loading.
• Utilise Python for advanced data processing, automation tasks, and system integration.
• Be an advisor with your In-depth knowledge of Snowflake architecture, features, and best practices.
• Develop and maintain complex data pipelines and ETL processes in Snowflake.
• Collaborate with data architects, analysts, and stakeholders to design optimal and scalable data solutions.
• Automate DBT Jobs & build CI/CD pipelines using Azure DevOps for seamless deployment of data solutions.
• Ensure data quality, integrity, and compliance throughout the data lifecycle.
• Troubleshoot, optimize, and enhance existing data processes and queries for performance improvements.
• Document data models, processes, and workflows clearly for future reference and knowledge sharing.
• Build Data tests, Unit tests and mock data frameworks
• Good to have AWS and Streamlit knowledge

SKILLS

Must have

• Master's degree in computer science, Information Technology, or a related field.
• 8 years of overall experience in data engineering, with a minimum of 5-6 years of relevant and hands-on expertise in Snowflake and DBT. At least 8 years of proven experience as a Snowflake Developer or in a similar data engineering role.
• Proficiency in using Fivetran for automated ELT data ingestion, with experience in integrating Fivetran pipelines with dbt and Snowflake for scalable data solutions.
• Extensive hands-on experience in writing complex SQL queries and advanced Python, demonstrating proficiency in data manipulation and analysis for large data volumes.
• Strong understanding of data warehousing concepts, methodologies, and technologies with in-depth experience in data modelling techniques (OLTP, OLAP, Data Vault 2.0)
• Experience building data pipelines using DBT (Data Build Tool) for data transformation.
• Familiarity with advanced techniques for performance tuning methodologies in Snowflake including query optimization.
• Strong knowledge with CI/CD pipelines, preferably in Azure DevOps.
• Excellent problem-solving, analytical, and critical thinking skills.
• Strong communication, collaboration, and interpersonal skills.

Nice to have

• Knowledge of additional data technologies (e.g., AWS, Azure, GCP) is a plus.
• Knowledge of Infrastructure as Code (IAC) tools such as Terraform or cloud formation is a plus.
• Experience in leading projects or mentoring junior developers is advantageous.