AWS Data Engineer (Snowflake)_Bangalore / Hyderabad_6 to 10 yrs

Tata Consultancy Services; Bengaluru; On-site; INR 1,600,000 - 2,100,000; Full time

Job summary

Tata Consultancy Services in Bengaluru is seeking a hands-on Data Engineer to design and implement large-scale data pipelines, ETL/ELT processes, and data integration across cloud environments.

You will work with Snowflake, AWS Glue, PySpark, Python, and CI/CD tooling to ensure data quality, cost optimization, and reliable delivery. The role emphasizes scalable architecture and governance across batch and streaming ingestion.

Qualifications

• Hands-on data engineering experience with large-scale pipelines.
• Proficiency with Snowflake as data platform and cloud processing.
• Strong SQL skills for data analysis and validation.
• Experience in batch and event-driven data ingestion patterns.
• Familiarity with CI/CD tooling and data quality controls.

Responsibilities

• Design and implement scalable data pipelines for ingestion, processing, and delivery.
• Develop data quality checks, reconciliation, and audit controls.
• Collaborate with data science and analytics teams to support reporting needs.
• Optimize costs and performance through partitioning and tuning.

Skills

Data engineering

Financial data processing

Data quality checks

Reconciliation frameworks

Audit controls

Exception handling

Batch data ingestion

Event-driven ingestion

Data modelling

Partitioning

Performance tuning

Cost optimization

SQL

Python

Tools

AWS Glue

PySpark

Python

Snowflake

GitHub Actions

GitLab CI

Jenkins

AWS CodePipeline

Job description

• Strong hands-on experience in data engineering, ETL/ELT development, and large-scale data pipeline design.
• Experience with AWS Glue, PySpark, Python, SQL, and cloud-based data processing.
• Strong experience working with Snowflake as a data warehouse or enterprise data platform.
• Good understanding of usage-based billing, rating engines, invoice feeds, or financial data processing.
• Experience building data quality checks, reconciliation frameworks, audit controls, and exception handling processes.
• Hands-on experience with CI/CD tools such as GitHub Actions, GitLab CI, Jenkins, AWS Code Pipeline, or similar.
• Strong SQL skills for data analysis, validation, troubleshooting, and performance optimization.
• Experience working with batch and event-driven data ingestion patterns.
• Understanding of data modelling, partitioning, performance tuning, and cost optimization