Senior ETL Developer

HTC Global Services; Chennai District; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

HTC Global Services in Chennai, India seeks an experienced Senior Snowflake & Python ETL Developer to lead enterprise-scale data pipelines and mentor junior team members. You will design and implement high-performance ETL frameworks using Snowflake and Python, optimize SQL, and drive best practices across the data engineering practice.

Ideal candidate brings 8-10 years in data engineering with Snowflake, Python, and CI/CD expertise, plus leadership and collaboration skills to deliver reliable,

Qualifications

• 8-10 years of progressive experience in data engineering with at least 3 years focused on Snowflake and Python-based ETL.
• Expert-level Snowflake proficiency including Snowpipe, Snowpark, streams, and dynamic tables with performance tuning.
• Advanced Python production-grade ETL framework development, reusable libraries, and design patterns.
• Proven track record deploying enterprise-scale ETL pipelines processing terabytes of data with reliability and scale.

Responsibilities

• Own complex data engineering initiatives from conception through production deployment.
• Develop high-performance ETL frameworks using Snowflake and Python.
• Establish scalable patterns and standards for maintainability across teams.
• Mentor junior and mid-level developers; lead code reviews and best-practice adoption.
• Monitor data quality, pipeline reliability, and operational efficiency.
• Implement monitoring, alerting, and automated testing for data products.

Skills

Data engineering

Python programming

SQL optimization

Mentorship

Leadership

Agile/Scrum

Technical communication

Education

Bachelor’s degree in CS/IS/Engineering

Tools

Snowflake

Git

CI/CD

Apache Airflow

Autosys

Kafka

Job description

We're seeking an experienced Senior Snowflake & Python ETL Developer to lead the design and implementation of enterprise-scale data pipelines that drive critical business insights. In this role, you'll develop sophisticated data solutions, mentor junior team members, and establish best practices for our growing data engineering practice. This position offers the opportunity to make significant technical contributions while shaping the direction of our data infrastructure.

Key Responsibilities

• Take ownership of complex data engineering initiatives from conception through production deployment.
• Develop and implement high-performance ETL frameworks using Snowflake and Python,
• Establish patterns and standards that other developers can follow while ensuring scalability, reliability, and maintainability.
• Leverage advanced Snowflake features including Snowpark , Snowpipe for real-time ingestion, streams and tasks for event-driven processing, dynamic tables for incremental transformations, and stored procedures for complex business logic.
• Conduct code reviews, mentor junior and mid-level developers.
• Identify opportunities to improve data quality, pipeline reliability, and operational efficiency.
• Implement comprehensive monitoring and alerting systems,
• Develop automated testing frameworks, and self-service capabilities that empower data consumers across the organization.

Production Support:

• Participate in a rotational production support schedule (approximately one month rotations) to monitor data pipelines, respond to alerts, and resolve operational issues.
• Troubleshoot production issues, perform root cause analysis, and implement permanent fixes that prevent recurrence.

Required Qualifications

Technical Skills & Experience:

• 8-10 years of progressive experience in data engineering, with at least 3 years focused on Snowflake and Python-based ETL development
• Expert-level proficiency in Snowflake, including advanced features (Snowpipe,snowpark, streams, tasks, dynamic tables), performance tuning, resource optimization, query profiling, and data sharing capabilities
• Advanced Python programming skills with demonstrated ability to build robust, production-grade ETL frameworks, implement design patterns, and develop reusable libraries
• Proven track record of architecting and deploying enterprise-scale ETL pipelines processing terabytes of data with high reliability and performance
• Deep expertise in SQL optimization, including complex window functions, recursive CTEs, and execution plan analysis
• Strong experience with version control (Git), CI/CD pipelines for data workflows, and infrastructure-as-code practices
• Comprehensive understanding of data modeling methodologies (dimensional modeling, Data Vault, star/snowflake schemas) and when to apply each approach
• Experience mentoring developers and leading technical initiatives

Education:

• Bachelor’s degree in computer science, Information Systems, Engineering, or related technical field; Master's degree preferred, or equivalent practical experience

Preferred Qualifications

• Extensive hands-on experience with AWS services (Glue, S3, Lambda, Step Functions, EventBridge) and their integration with Snowflake
• Good to have experience in the asset management industry with understanding of investment data workflows, portfolio analytics, risk management data, or fund accounting processes
• Experience with workflow orchestration platforms (Apache Airflow, Autosys)
• Knowledge of data streaming technologies (Kafka, SNS) and real-time processing patterns
• Good to have SnowPro certifications (Data Engineer, Architect) and/or AWS Professional certifications
• Understanding of data governance, security, and compliance frameworks
• Experience working in Agile/Scrum environments

Technical Leadership:

You demonstrate expertise that inspires confidence and provide clear technical direction while remaining open to alternative approaches and continuous learning.

Strategic Thinking:

You balance immediate technical needs with long-term architectural vision, making decisions that support scalability and maintainability.

Mentorship:

You invest in developing others' skills through code reviews, pairing sessions, and knowledge sharing, elevating the entire team's capabilities.

Problem-Solving:

You tackle ambiguous, complex challenges with structured thinking, breaking down problems systematically and designing solutions that address root causes rather than symptoms.

Communication:

You articulate technical concepts clearly to diverse audiences, creating alignment between technical teams and business stakeholders while documenting decisions and rationale effectively.

Ownership & Accountability:

You take end-to-end responsibility for your initiatives, following through from design to production support and measuring success through defined metrics.