Job opening For Sr. Data Engineer@ GlobalData- Ai Palette -BLR

Globaldata; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

GlobalData in Bengaluru is seeking a Senior Data Engineer to build and maintain Python-based ETL pipelines, develop Airflow DAGs, and ensure data quality across data platforms. You will optimize SQL queries, manage data ingestion, and support data storage systems while focusing on observability and reliability.

You will collaborate with product and analytics teams, guide junior engineers, and drive improvements to the data layer with scalable solutions in a fast-paced environment.

Qualifications

• 4-8 years of experience in data engineering or related technical roles.
• Proficient with Python for production scripts and data processing with pandas/NumPy.
• Strong SQL skills including joins, aggregations, window functions, and indexing basics.
• PostgreSQL experience; JSONB familiarity is a plus.
• Experience building automation scripts for data processing, validation, or reporting.
• Familiarity with orchestration tools (Airflow/Prefect).
• Git, Docker and standard development workflows; writing unit tests.

Responsibilities

• Build and maintain Python-based ETL pipelines and data automation scripts.
• Write and optimize SQL queries in PostgreSQL and manage schema changes.
• Develop and maintain Airflow DAGs for batch scheduling and orchestration.
• Build data validation and quality checks to ensure pipeline reliability.
• Support Elasticsearch index maintenance, data ingestion, and mappings updates.
• Integrate LLM outputs into structured data pipelines and storage systems.
• Write unit tests and instrument code for observability.
• Guide junior engineers on data pipeline initiatives.
• Collaborate with product teams to design and improve the data layer.

Skills

Python

SQL

pandas

NumPy

JSONB

Data pipelines

Unit tests

Observability

LLM integration

Tools

Airflow

PostgreSQL

Git

Docker

Prefect

Job description

Hello,

Greetings from GlobalData!!!

Urgent job opening for Senior Data Engineer - GD @Ai Palette - BLR

Position Title: Senior Data Engineer

Key Responsibilities

• Build and maintain Python-based ETL pipelines and data automation scripts using pandas and NumPy
• Write and optimize SQL queries in PostgreSQL, schema changes, and maintain data integrity
• Develop and maintain Apache Airflow DAGs for batch scheduling and pipeline orchestration
• Build data validation and quality check scripts to ensure pipeline reliability
• Support Elasticsearch index maintenance, data ingestion, and basic mapping updates
• Integrate LLM-generated outputs into structured data pipelines and storage systems
• Write unit tests for data pipelines and instrument code for observability
• Guide junior engineers on data pipeline initiatives
• Collaborate with the product team to design and improve the data layer.

Key Qualifications

• 4-8 years of experience in data engineering, backend engineering, or a related technical role
• Python (strong): comfortable writing production scripts, proficient with pandas and numpy for data processing and transformation
• SQL (solid): can write complex queries, understands joins, aggregations, window functions, and indexing basics
• PostgreSQL experience: basic schema understanding, data types, JSONB familiarity is a plus
• Experience building automation scripts for data processing, validation, or reporting.
• Familiarity with at least one orchestration tool (Airflow, Prefect, or similar)
• Git, Docker, and standard development workflows
• Writes test cases as part of development.

Thanks & Regards

Tejaswini.P

(Human Resource)