Senior Data Engineer

Insight Global; Bengaluru; On-site; INR 2,000,000 - 3,600,000; Full time

Job summary

Insight Global in Bengaluru seeks a data architecture and engineering lead with 5-8+ years of hands-on experience to deliver modern cloud data platforms. This role requires deep knowledge of data lakehouse architectures and data modeling.

You will work with Databricks and Fabric, Python, SQL, Spark, and orchestration frameworks; implement ETL/ELT tools, Docker and Kubernetes; expose REST APIs and GraphQL, and integrate AI/GenAI components into scalable data solutions.

Qualifications

• 5-8+ years of hands-on experience in data architecture and engineering delivery
• Proven success in building modern data platforms on cloud (Azure, AWS, GCP)
• Deep knowledge of data lakehouse architectures (e.g., Databricks, Fabric)
• Proficiency with Python, SQL, Spark, and orchestration frameworks
• Experience with ETL/ELT tools (Informatica, Talend, Fivetran) and containerization (Docker, Kubernetes)
• Strong background in Data Modeling (ERD, star/snowflake, canonical models)
• Familiarity with REST APIs, GraphQL, and event-driven design
• Demonstrated experience integrating AI/ML and GenAI components into data platforms
• Exposure to DataOps and DevOps practices for CI/CD and platform automation

Responsibilities

• 5-8+ years of hands-on experience in data architecture and engineering delivery
• Proven success in building modern data platforms on cloud (Azure, AWS, GCP)
• Deep knowledge of data lakehouse architectures (e.g., Databricks, Fabric)
• Proficiency with Python, SQL, Spark, and orchestration frameworks
• Experience with ETL/ELT tools (e.g., Informatica, Talend, Fivetran) and containerization (Docker, Kubernetes)
• Strong background in Data Modeling (ERD, star/snowflake, canonical models)
• Familiarity with REST APIs, GraphQL, and event-driven design
• Demonstrated experience integrating AI/ML and GenAI components into data platforms
• Exposure to DataOps and DevOps practices for CI/CD and platform automation
• Nice to Have: CI/CD (Azure DevOps or GitHub), NoSQL (MongoDB), IoT data standards (Haystack, Brick, Real Estate Core)

Skills

Data architecture

Data engineering

Cloud platforms

Data lakehouse

Databricks

Fabric

Python

SQL

Spark

Orchestration

ETL tools

Informatica

Talend

Fivetran

Docker

Kubernetes

Data Modeling

REST APIs

GraphQL

Event-driven

AI/ML

GenAI

DataOps

DevOps

Tools

Databricks

Kubernetes

Docker

Azure DevOps

GitHub

Job description

Role & responsibilities

5-8+ years of hands-on experience in data architecture and engineering delivery. Proven success in building modern data platforms on cloud (Azure, AWS, GCP). Deep knowledge of data lakehouse architectures (e.g., Databricks, Fabric). Proficiency with Python, SQL, Spark, and orchestration frameworks. Experience with ETL/ELT tools (e.g., Informatica, Talend, Fivetran) and containerization (Docker, Kubernetes). Strong background in Data Modeling (ERD, star/snowflake, canonical models). Familiarity with REST APIs, GraphQL, and event-driven design. Demonstrated experience integrating AI/ML and GenAI components into data platforms. Exposure to DataOps and DevOps practices for CI/CD and platform automation.

Nice to Have Skills & Experience

• Working knowledge of code management and CI/CD systems (Azure DevOps or GitHub). Familiarity with NoSQL databases (e.g., MongoDB).
• Exposure to IoT Data Standards like Project Haystack, Brick Schema, Real Estate Core.