Data Engineering Senior Associate

The Depository Trust & Clearing Corporation (DTCC); Chennai District; Hybrid; INR 1,500,000 - 2,600,000; Full time

Benefits offered by this job

Healthcare & life insurance

Pension / Retirement benefits

Paid Time Off & family care leaves

Hybrid onsite/remote model

Job summary

The Depository Trust & Clearing Corporation (DTCC) is seeking a Senior Data Engineer in Chennai region to design, build, and optimize enterprise data pipelines. You will work with Snowflake, dbt, Airflow, Python, and advanced SQL to enable analytics and governance across platforms.

The role emphasizes scalable architecture and collaboration with data architects and stakeholders. DTCC offers a hybrid work model with 3 days onsite and 2 days remote, along with a comprehensive benefits package and

Qualifications

• Strong hands-on experience with Snowflake, dbt, Airflow, Python, and Advanced SQL.
• Expertise in dimensional data modeling and Medallion Architecture.
• Experience with Apache Iceberg table optimization and performance tuning.
• Knowledge of data governance, security, and compliance.

Responsibilities

• Design, build, and maintain scalable enterprise data pipelines and data products.
• Develop data models following Medallion Architecture to support analytics and reporting.
• Implement and manage Iceberg tables with partitioning and lifecycle controls.
• Build Airflow DAGs for large-scale batch workflows with high reliability.
• Develop SQL transformations and data quality frameworks for governance.
• Optimize Snowflake workloads including performance and cost efficiency.
• Collaborate with architects and stakeholders to translate data needs into scalable solutions.
• Develop reusable dbt models, tests, and documentation; promote best practices.
• Use PySpark for distributed data processing when needed.
• Apply Terraform-based IaC to provision cloud data platform resources.
• Support CI/CD for data engineering with Git workflows and automated tests.
• Leverage Snowflake Cortex and AI capabilities for enrichment and analytics.
• Containerize apps with Docker and follow modern DevOps practices.
• Mentor junior engineers and contribute to code reviews and architectural discussions.

Skills

Snowflake

dbt

Airflow

Python

Advanced SQL

Dimensional modeling

Medallion Architecture

PySpark

Docker

Git

Terraform

Tools

Docker

Git

Terraform

Job description

Job Description:

Are you ready to make an impact at DTCC?
Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We are committed to helping our employees grow and succeed. We believe that you have the skills and drive to make a real impact. We foster a thriving internal community and are committed to creating a workplace that looks like the world that we serve.

Pay and Benefits:

• Competitive compensation, including base pay and annual incentive
• Comprehensive health and life insurance and well-being benefits, based on location
• Pension / Retirement benefits
• Paid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well-being.
• DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee).

The Impact you will have in this role:

The Development family is responsible for creating, designing, deploying, and supporting applications, programs, and software solutions. May include research, new development, prototyping, modification, reuse, re-engineering, maintenance, or any other activities related to software products used internally or externally on product platforms supported by the firm. The software development process requires in-depth subject matter expertise in existing and emerging development methodologies, tools, and programming languages. Software Developers work closely with business partners and / or external clients in defining requirements and implementing solutions. The Software Engineering role specializes in planning, documenting technical requirements, designing, developing, and testing all software systems and applications for the firm. Works closely with architects, product managers, project management, and end-users in the development and enhancement of existing software systems and applications, proposing and recommending solutions that solve complex business problems.

Key Responsibilities

• Design, build, and maintain scalable enterprise data pipelines and data products using Snowflake, dbt, Python, and Apache Airflow.
• Develop and optimize data models following Medallion Architecture (Bronze, Silver, Gold) principles to support analytics, reporting, and downstream data consumption.
• Implement and manage Apache Iceberg tables, ensuring efficient data storage, partitioning, lifecycle management, and performance optimization.
• Build and maintain complex Airflow DAGs to orchestrate large-scale batch and data processing workflows with high reliability and observability.
• Develop advanced SQL transformations and data quality frameworks to ensure data accuracy, consistency, and governance across platforms.
• Optimize Snowflake workloads by monitoring query performance, warehouse sizing, clustering strategies, and credit consumption to improve cost efficiency.
• Collaborate with data architects, platform teams, and business stakeholders to translate data requirements into scalable technical solutions.
• Develop reusable dbt models, macros, tests, and documentation while promoting data engineering best practices.
• Utilize PySpark for large-scale data processing and transformation activities where distributed computing is required.
• Implement infrastructure-as-code solutions using Terraform to automate provisioning and management of cloud data platform resources.
• Support CI/CD implementation for data engineering solutions using Git-based workflows, automated testing, and deployment pipelines.
• Leverage Snowflake Cortex and AI-powered capabilities to enable intelligent data processing, enrichment, and analytical use cases.
• Containerize and deploy data engineering applications using Docker and modern DevOps practices.
• Conduct performance tuning, troubleshooting, and root cause analysis across data pipelines, orchestration workflows, and storage layers.
• Ensure adherence to data governance, security, compliance, and operational standards across enterprise data platforms.
• Mentor junior team members and contribute to architecture reviews, code reviews, and engineering best practices.

Preferred Skills & Expertise

• Strong hands-on experience in Snowflake, dbt, Airflow, Python, and Advanced SQL.
• Expertise in dimensional data modeling, star/snowflake schemas, and Medallion Architecture.
• Experience with Apache Iceberg table optimization, compaction, partition evolution, and query performance tuning.
• Knowledge of data orchestration, monitoring, lineage, and observability frameworks.
• Familiarity with cloud-native data platforms, CI/CD pipelines, DevOps practices, and Infrastructure as Code.
• Strong analytical, problem-solving, and stakeholder management skills.

Senior Associate Expectations

• Own medium-to-large data engineering initiatives with minimal supervision.
• Drive technical design discussions and recommend scalable architecture solutions.
• Balance performance, cost, reliability, and maintainability across data platform implementations.
• Participate in production support and continuously improve platform stability and operational excellence.

Actual salary is determined based on the role, location, individual experience, skills, and other considerations. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.