Senior Data Engineer — Snowflake, CDC & Airflow Expert

Tata Consultancy Services; Raleigh (NC); On-site; USD 100,000 - 120,000; Full time

Job summary

Tata Consultancy Services is seeking a Senior Data Engineer to architect, build, and optimize enterprise data pipelines across cloud, on prem, and hybrid environments. The role emphasizes Snowflake, Qlik Replicate, DBT Cloud, Astronomer Airflow, and Python ingestion frameworks with strong governance and CI/CD practices.

The ideal candidate thrives in complex data ecosystems, bringing automation, metadata driven design, and secure ingestion.

Qualifications

• 8+ years of hands on data engineering experience.
• Deep expertise with Snowflake including masking, RBAC, performance tuning.
• Strong experience with Qlik Replicate for CDC and database replication.
• Excellent proficiency in Python and PySpark for ingestion frameworks and automation.
• Hands on experience with DBT Cloud and Astronomer Airflow.
• Experience with schema drift detection and CI/CD pipelines.
• Familiarity with Protegrity or similar data protection platforms.

Responsibilities

• Design and implement scalable, resilient data pipelines across cloud, on prem, and hybrid environments.
• Build and maintain DBT models with strong testing, documentation, and lineage.
• Develop Python ingestion frameworks for files and APIs with schema validation and metadata capture.
• Engineer ingestion for CSV, fixed width, JSON, XML, Excel, and semi structured formats.
• Configure and manage Qlik Replicate tasks for CDC and full load replication.
• Implement data masking, tokenization, and RBAC for governance across Snowflake.

Skills

Python

Pyspark

Airflow

SQL

CI/CD

Data governance

Tools

Snowflake

Qlik Replicate

DBT Cloud

Astronomer Airflow

GitLab

Job description

Tata Consultancy Services is seeking a Senior Data Engineer to architect, build, and optimize enterprise data pipelines across cloud, on prem, and hybrid environments. The role emphasizes Snowflake, Qlik Replicate, DBT Cloud, Astronomer Airflow, and Python ingestion frameworks with strong governance and CI/CD practices.

The ideal candidate thrives in complex data ecosystems, bringing automation, metadata driven design, and secure ingestion.