Senior Data Engineer / Technical Lead – Databricks & Snowflake

Blumetra Solutions; Hyderabad; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

Blumetra Solutions is seeking a highly skilled Senior Data Engineer/Lead to develop scalable data pipelines and optimize data workflows. Located in Hyderabad, this role combines advanced SQL and technologies like Databricks and Snowflake.

The candidate will design enterprise data architectures, mentor teams, and implement best practices in data engineering for effective performance and cost efficiency in a hybrid work setting.

Qualifications

• Experience with designing scalable batch and real-time data pipelines.
• Hands-on with optimizing high-volume workloads.
• Knowledge of Data Warehousing, Data Vault, and Data Mesh.

Responsibilities

• Design and develop scalable data pipelines using PySpark.
• Build and optimize data models using Snowflake.
• Implement CI/CD and DevOps practices for pipelines.
• Provide technical leadership and team mentorship.

Skills

PySpark

Databricks

Snowflake

DBT

Advanced SQL

REST APIs

AWS

Azure

Kafka/Event Hub/Kinesis

Terraform

Job description

Overview

Experience: 7 - 12 years

Mandatory Skills: Databricks, Snowflake, PySpark, SQL

Job Summary

We are seeking a highly skilled Senior Data Engineer/Lead with strong expertise in PySpark, Databricks, Snowflake, DBT, and advanced SQL. The ideal candidate should have hands-on experience building enterprise-scale batch and real-time data pipelines, optimizing high-volume workloads, and designing modern data architectures. The candidate should possess strong knowledge of Data Warehousing, Data Vault, Data Mesh, Lakehouse, Data Lake, and Microsoft Fabric architectures and should be capable of designing scalable enterprise solutions.

Work Location

Hyderabad (Hybrid Model) — Prestige Skytech, Financial District

Key Responsibilities

• Design and develop scalable batch and streaming data pipelines using PySpark and Databricks
• Build and optimize enterprise data models and transformation pipelines using Snowflake and DBT
• Develop advanced SQL scripts, stored procedures, and performance-optimized queries
• Design and implement real-time streaming architectures
• Build integrations using APIs, event-driven architectures, and cloud-native services
• Optimize workloads for performance, scalability, and cost efficiency
• Design enterprise data platforms using Lakehouse, Data Mesh, Data Vault, and Fabric principles
• Work with cross-functional teams to build scalable analytics and data engineering solutions
• Implement CI/CD and DevOps practices for data engineering pipelines
• Provide technical leadership and mentor engineering teams

Required Skills

• Strong hands-on experience with PySpark
• Expertise in Databricks
• Strong Snowflake experience
• Strong DBT knowledge
• Advanced SQL expertise
• Strong experience with Stored Procedures and complex SQL optimization
• Hands-on experience with streaming frameworks and real-time processing
• Experience with REST APIs and enterprise integrations
• Strong understanding of distributed data processing
• Working knowledge of AWS and/or Azure
• Excellent analytical and debugging skills

Strong Knowledge Of

• Data Warehousing
• Data Vault Modeling
• Data Mesh
• Data Lake & Lakehouse Architecture
• Microsoft Fabric
• Enterprise Data Architecture Patterns

Good to Have

• Kafka/Event Hub/Kinesis
• Airflow
• Terraform
• Unity Catalog
• Delta Live Tables
• CI/CD pipelines