Data Engineer - Snowflake

CoffeeBeans; Bengaluru; Hybrid; INR 1,500,000 - 2,600,000; Full time

Job summary

CoffeeBeans Consulting is seeking a Data Engineer - L2 to design, develop, and maintain robust data pipelines using Python, SQL, Snowflake, and AWS. You will collaborate with cross-functional teams to support healthcare data ingestion and analytics, applying AI-native SDLC practices to improve productivity and processing performance.

The role focuses on building scalable pipelines, optimizing data quality, and delivering high-quality data solutions across production environments in a hybrid work

Qualifications

• 3–6 years of data engineering experience.
• Experience building scalable data pipelines and integration frameworks.
• Healthcare data ingestion and analytics experience preferred.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python, SQL, Snowflake, and AWS.
• Build and support healthcare data ingestion, transformation, and analytical solutions.
• Collaborate with product, business, and QA teams to deliver high-quality data solutions.
• Optimize data processing performance, reliability, and data quality.
• Leverage AI-native development practices, including AI tools for code generation, reviews, and test creation.

Skills

Python

SQL

Snowflake

PySpark

AWS

ETL

AI SDLC

Automation

Big Data

Tools

Snowpark

Airflow

GitHub Actions

Jenkins

Splunk

Shell scripting

Job description

Experience: 3-6 years of relevant experience in data engineering. | Location: Bangalore, Hyderabad, Gurugram. | Work Mode: Hybrid work environment, promoting flexibility and collaboration.

About Us

CoffeeBeans Consulting is a premier tech consulting firm dedicated to empowering organizations to become AI-ready by optimizing their data across diverse sources. Our expertise spans data architecture, pipelines, governance, MLOps, and cutting‑edge Generative AI solutions.

Role Overview

Join CoffeeBeans Consulting as a Data Engineer - L2 and transform the future of data engineering in the Generative AI landscape. In this pivotal role, you will design, develop, and maintain robust data pipelines using Python, SQL, Snowflake, and AWS, enabling our clients to harness the power of AI-driven insights. Collaborate with cross‑functional teams to deliver high-quality data solutions that support healthcare data ingestion and analytical needs. Leverage AI-native development practices to enhance productivity and optimize data processing performance, making a significant impact in a rapidly evolving industry.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python, SQL, Snowflake, and AWS.
• Build and support healthcare data ingestion, transformation, and analytical solutions.
• Collaborate with product, business, and QA teams to deliver high-quality data solutions.
• Optimize data processing performance, reliability, and data quality across production environments.
• Leverage AI-native development practices, including AI agents/tools for code generation, code reviews, and test case creation.

Required Qualifications

• Experience building and maintaining scalable data pipelines and data integration frameworks.

Required Skills

• Strong Python development skills with experience in ETL, data processing, and automation.
• Advanced SQL and Snowflake expertise, including data modeling and performance optimization.
• Experience with PySpark and Big Data technologies for processing large-scale datasets.
• Proficiency in AWS services such as S3, SNS, Glue, and cloud-based data engineering solutions.
• Familiarity with AI-native SDLC practices, including the use of AI tools for development and testing.

Preferred Skills

• Experience with Snowpark for data processing.
• Knowledge of Shell/Unix scripting and workflow orchestration tools like Airflow.
• Familiarity with REST APIs for data integration.
• Experience with CI/CD tools such as GitHub Actions and Jenkins.
• Understanding of monitoring tools such as Splunk.