Data Engineer IRC301397

GlobalLogic; Bengaluru; On-site; INR 2,500,000 - 4,200,000; Full time

Benefits offered by this job

Flexible work schedules

Work from home options

Professional development opportunities

Employee benefits package

Job summary

GlobalLogic in Bengaluru is seeking a Senior Data Engineer to design, develop and optimize scalable ETL/ELT pipelines using DBT, SSIS, and Python. You will build and optimize SQL objects across SQL Server, PostgreSQL, and Snowflake, and automate workflows with Apache Airflow.

The role requires 5+ years in data engineering or ETL development, strong SQL skills, Python (NumPy/Pandas), and hands-on AWS experience. Agile practices and collaboration with cross-functional teams are expected.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Strong knowledge of SQL and relational database concepts.
• Experience with Microsoft SQL Server, PostgreSQL, and Snowflake.
• Proficient in Python with NumPy and Pandas.
• Familiarity with PySpark for distributed processing.
• Experience building ETL/ELT pipelines using SSIS and DBT.
• Experience with Apache Airflow for scheduling workflows.
• Hands-on with AWS services (S3, Lambda, EC2, RDS, IAM).
• Excellent collaboration, communication, and problem-solving skills.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using DBT, SSIS, and Python.
• Develop and optimize SQL queries, stored procedures, and database objects in MS SQL Server, PostgreSQL, and Snowflake.
• Build and automate data workflows using Apache Airflow.
• Manage and optimize cloud-based data solutions on AWS (S3, Lambda, EC2, RDS, IAM).
• Implement data quality checks, validation, and monitoring for production pipelines.
• Troubleshoot production issues, optimize pipeline performance, and resolve data-related problems.
• Maintain code quality through Git version control, code reviews, and documentation.
• Develop shell scripts to automate operational and deployment tasks.
• Containerize applications and data services using Docker.
• Participate in Agile ceremonies (sprint planning, stand-ups, retrospectives).
• Utilize AI-assisted development tools (GitHub Copilot, Claude) to improve productivity.
• Document technical designs, workflows, and progress using Jira and Confluence.

Skills

SQL

Python

Airflow

AWS

DBT

SSIS

Snowflake

PostgreSQL

Microsoft SQL Server

Docker

Git

Jira

Confluence

Pandas

NumPy

PySpark

Education

Bachelor’s degree in Computer Science/IT or related field

Tools

Docker

Kubernetes

Apache Airflow

DBT

SSIS

Snowflake

Microsoft SQL Server

PostgreSQL

Python (NumPy/Pandas)

Job description

Design, develop, and maintain scalable ETL/ELT data pipelines using DBT, SSIS, and Python
Develop and optimize SQL queries, stored procedures, and database objects in Microsoft SQL Server, PostgreSQL, and Snowflake
Build and automate data workflows using Apache Airflow
Manage and optimize cloud-based data solutions on AWS (S3, Lambda, EC2, RDS, IAM)
Implement data quality checks, validation, and monitoring for production pipelines
Troubleshoot production issues, optimize pipeline performance, and resolve data-related problems
Maintain code quality through Git version control, code reviews, and documentation
Develop shell scripts to automate operational and deployment tasks
Containerize applications and data services using Docker
Participate in Agile ceremonies including sprint planning, stand-ups, and retrospectives
Utilize AI-assisted development tools such as GitHub Copilot and Claude to improve productivity and code quality
Document technical designs, workflows, and project progress using Jira and Confluence

Job Description:

Bachelor’s degree in Computer Science, Information Technology, or a related field with 5+ years of experience in Data Engineering or ETL Development
Strong knowledge of SQL and relational database concepts
Experience working with Microsoft SQL Server, PostgreSQL, and Snowflake
Strong programming skills in Python with experience using NumPy and Pandas
Basic knowledge of PySpark for distributed data processing
Experience building ETL/ELT pipelines using SSIS and DBT
Experience scheduling and orchestrating workflows using Apache Airflow
Hands-on experience with AWS services including:-
1. Amazon S3
2. AWS Lambda
3. Amazon EC2
4. Amazon RDS
5. AWS IAM

Strong understanding of database concepts including:-
Normalization and Denormalization
1. OLTP vs OLAP
2. Data Warehousing
3. Data Modeling
4. Performance Tuning

Experience with Git version control and collaborative development workflows
Knowledge of Docker and containerized application deployment
Experience with Shell Scripting for automation
Familiarity with Agile methodologies and project management tools such as Jira and Confluence
Strong analytical, problem-solving, and communication skills

Nice to Have:

Experience with cloud-native data platforms and modern data architectures
Knowledge of data processing using PySpark on large datasets
Exposure to CI/CD pipelines and DevOps practices
Experience using AI-assisted development tools such as GitHub Copilot or Claude
Understanding of data governance, security, and best practices for cloud data platforms

Requirements

Job Responsibilities:

• Design, develop, and maintain scalable ETL/ELT data pipelines using DBT, SSIS, and Python
• Develop and optimize SQL queries, stored procedures, and database objects in Microsoft SQL Server, PostgreSQL, and Snowflake
• Build and automate data workflows using Apache Airflow
• Manage and optimize cloud-based data solutions on AWS (S3, Lambda, EC2, RDS, IAM)
• Implement data quality checks, validation, and monitoring for production pipelines
• Troubleshoot production issues, optimize pipeline performance, and resolve data-related problems
• Maintain code quality through Git version control, code reviews, and documentation
• Develop shell scripts to automate operational and deployment tasks
• Containerize applications and data services using Docker
• Participate in Agile ceremonies including sprint planning, stand-ups, and retrospectives
• Utilize AI-assisted development tools such as GitHub Copilot and Claude to improve productivity and code quality
• Document technical designs, workflows, and project progress using Jira and Confluence

Job Description:

• Bachelor’s degree in Computer Science, Information Technology, or a related field with 5+ years of experience in Data Engineering or ETL Development
• Strong knowledge of SQL and relational database concepts
• Experience working with Microsoft SQL Server, PostgreSQL, and Snowflake
• Strong programming skills in Python with experience using NumPy and Pandas
• Basic knowledge of PySpark for distributed data processing
• Experience building ETL/ELT pipelines using SSIS and DBT
• Experience scheduling and orchestrating workflows using Apache Airflow
• Hands‑on experience with AWS services including:-
• Strong understanding of database concepts including:-
• Normalization and Denormalization

1. OLTP vs OLAP
2. Data Warehousing
3. Data Modeling
4. Performance Tuning

• Experience with Git version control and collaborative development workflows
• Knowledge of Docker and containerized application deployment
• Experience with Shell Scripting for automation
• Familiarity with Agile methodologies and project management tools such as Jira and Confluence
• Strong analytical, problem‑solving, and communication skills

Nice to Have:

• Experience with cloud‑native data platforms and modern data architectures
• Knowledge of data processing using PySpark on large datasets
• Exposure to CI/CD pipelines and DevOps practices
• Experience using AI‑assisted development tools such as GitHub Copilot or Claude
• Understanding of data governance, security, and best practices for cloud data platforms

Job responsibilities

Same as above

What we offer

• Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.
• Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
• Work-Life Balance: GlobalLogic prioritizes work‑life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.
• Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.
• Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.
• Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward‑thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.