Data Engineer Snowflakes

CoffeeBeans; Bengaluru Urban; On-site; INR 1,400,000 - 2,100,000; Full time

Job summary

CoffeeBeans Consulting is seeking a Data Engineer - L2 to design, develop, and maintain robust data pipelines using Python, SQL, Snowflake, and AWS. You will enable AI-driven insights for healthcare data ingestion and analytics, collaborating with cross-functional teams to deliver high-quality data solutions.

In this role, you’ll apply AI-native development practices to improve productivity, optimize data processing performance, and ensure data quality across production environments,

Qualifications

• Experience building scalable data pipelines and integration frameworks.
• Proficient in ETL, data processing, and automation using Python.
• Strong SQL, Snowflake data modeling, and performance optimization.

Responsibilities

• Design, develop, and maintain scalable data pipelines with Python, SQL, Snowflake, and AWS.
• Build and support healthcare data ingestion, transformation, and analytics.
• Collaborate with product, business, and QA teams to deliver data solutions.
• Optimize data processing performance, reliability, and data quality in production.
• Leverage AI-native development practices and AI tools for code generation and testing.

Skills

Python ETL

SQL

Snowflake

PySpark

AWS

AI-native SDLC

Tools

Airflow

GitHub Actions

Jenkins

Splunk

Snowpark

Job description

CoffeeBeans Consulting is a premier tech consulting firm dedicated to empowering organizations to become AI-ready by optimizing their data across diverse sources. Our expertise spans data architecture, pipelines, governance, MLOps, and cutting-edge Generative AI solutions.

Role Overview

Join CoffeeBeans Consulting as a Data Engineer - L2 and transform the future of data engineering in the Generative AI landscape. In this pivotal role, you will design, develop, and maintain robust data pipelines using Python, SQL, Snowflake, and AWS, enabling our clients to harness the power of AI-driven insights. Collaborate with cross-functional teams to deliver high-quality data solutions that support healthcare data ingestion and analytical needs. Leverage AI-native development practices to enhance productivity and optimize data processing performance, making a significant impact in a rapidly evolving industry.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python, SQL, Snowflake, and AWS.
• Build and support healthcare data ingestion, transformation, and analytical solutions.
• Collaborate with product, business, and QA teams to deliver high-quality data solutions.
• Optimize data processing performance, reliability, and data quality across production environments.
• Leverage AI-native development practices, including AI agents/tools for code generation, code reviews, and test case creation.

Required Qualifications

• Experience building and maintaining scalable data pipelines and data integration frameworks.

Required Skills

• Strong Python development skills with experience in ETL, data processing, and automation.
• Advanced SQL and Snowflake expertise, including data modeling and performance optimization.
• Experience with PySpark and Big Data technologies for processing large-scale datasets.
• Proficiency in AWS services such as S3, SNS, Glue, and cloud-based data engineering solutions.
• Familiarity with AI-native SDLC practices, including the use of AI tools for development and testing.

Preferred Skills

• Experience with Snowpark for data processing.
• Knowledge of Shell/Unix scripting and workflow orchestration tools like Airflow.
• Familiarity with REST APIs for data integration.
• Experience with CI/CD tools such as GitHub Actions and Jenkins.
• Understanding of monitoring tools such as Splunk.