Data Engineer - N

Tata Consultancy Services; Hyderabad, Bengaluru, Delhi; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services in Hyderabad is seeking a data engineer to design and maintain scalable Snowflake-based data pipelines. The role focuses on ingestion, transformation, and orchestration using SQL, Python, and modern ETL tools.

You will collaborate with data analysts and architects to implement data models, warehousing concepts, and ensure data quality and security across cloud platforms such as AWS, Azure, or GCP.

Qualifications

• Experience with Snowflake Data Cloud and cloud data pipelines.
• Strong SQL and advanced query optimization skills.
• Proficiency in Python for data engineering tasks.
• ETL/ELT development and data transformation expertise.
• Experience with data modeling (Star/Snowflake/Dimentional).
• Solid understanding of data warehousing concepts.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Snowflake and cloud technologies.
• Build and optimize data ingestion, transformation, and orchestration processes.
• Design and implement data models, data marts, and enterprise data warehouse solutions in Snowflake.
• Develop ETL/ELT workflows using SQL, Python, and data integration tools.
• Collaborate with stakeholders to understand data requirements and deliver solutions.
• Tune queries and optimize Snowflake performance, storage, and compute usage.
• Implement data quality, governance, security, and monitoring practices.
• Support data migration from legacy platforms to Snowflake.
• Document data lineage and technical details.

Skills

Snowflake Data Cloud

SQL

Python

ETL/ELT

Data modeling

Data Warehousing

Tools

dbt

Airflow

Azure Data Factory

Informatica

Matillion

Talend

Fivetran

Job description

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Snowflake and cloud technologies.
• Build and optimize data ingestion, transformation, and orchestration processes.
• Design and implement data models, data marts, and enterprise data warehouse solutions in Snowflake.
• Develop ETL/ELT workflows using SQL, Python, and data integration tools.
• Collaborate with business stakeholders, data analysts, and architects to understand data requirements.
• Perform query tuning and optimize Snowflake performance, storage, and compute utilization.
• Implement data quality, governance, security, and monitoring practices.
• Support data migration initiatives from legacy platforms to Snowflake.
• Develop and maintain technical documentation and data lineage artifacts.
• Ensure adherence to enterprise security and compliance standards.

Required Skills

Core Technical Skills

• Strong hands-on experience with Snowflake Data Cloud.
• Proficiency in SQL and advanced query optimization.
• Experience with Python for data engineering and automation.
• Expertise in ETL/ELT development and data transformation.
• Experience with data modeling (Star Schema, Snowflake Schema, Dimensional Modeling).
• Strong understanding of Data Warehousing concepts.

Cloud & Integration

• Experience with one or more cloud platforms:
  • AWS
  • Azure
  • GCP
• Experience with cloud storage solutions such as S3, Azure Data Lake, or Google Cloud Storage.
• Knowledge of APIs and data integration frameworks.

Data Engineering Tools

Experience in one or more:

• dbt
• Airflow
• Azure Data Factory (ADF)
• Informatica
• Matillion
• Talend
• Fivetran

Nice-to-Have Skills

• Power BI, Tableau, or Looker
• Databricks
• Spark / PySpark
• Terraform / Infrastructure as Code
• Machine Learning data pipelines