Data Engineer II_india IRC302916

GlobalLogic; Bengaluru; On-site; INR 2,500,000 - 4,200,000; Full time

Benefits offered by this job

Exciting Projects

Collaborative Environment

Work-Life Balance

Professional Development

Excellent Benefits

Fun Perks

Job summary

GlobalLogic is seeking a Data Engineer to design and maintain scalable data pipelines on Databricks, using PySpark (Python) and SQL to transform data for analytics and reporting.

You will integrate data from diverse sources, manage batch and streaming ingest with AWS S3, and enable dashboards via Amazon QuickSight while upholding governance, quality, and security standards.

Qualifications

• Experience designing data pipelines and architectures using Databricks for analytics and operations.
• Experience building batch and streaming ingestion pipelines with AWS S3 as storage.
• Ability to harmonize data from multiple systems for accuracy and timeliness.
• Partner with stakeholders to translate business requirements into robust data models.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures using Databricks for analytics and operations.
• Build and manage batch and streaming ingestion pipelines, leveraging AWS S3 as the storage layer.
• Integrate data from multiple systems to ensure accuracy, consistency, and timely availability.
• Collaborate with stakeholders to translate business needs into robust data models and datasets.
• Enforce data governance, quality, and security standards across the data platform.
• Optimize data storage, query performance, and cost efficiency in cloud/big-data environments.

Skills

Databricks

AWS

PySpark

Python

SQL

S3

QuickSight

Job description

AWS, Databricks, PySpark, Python, QuickSight, S3, SQL

Mandatory Skill Det-Databricks AWS SQL PySpark Python QuickSight S3

Requirements

What You'll Do

• Design, develop, and maintain scalable data pipelines and architectures using Databricks to support analytics, reporting, and operational use cases.
• Build and manage batch and streaming ingestion pipelines, leveraging AWS S3 as the foundational storage layer.
• Integrate and harmonize data from multiple systems to ensure accuracy, consistency, and timely availability.
• Partner with stakeholders to translate business and analytics requirements into robust data models and datasets.
• Implement and enforce data governance, quality, and security standards across the data platform.
• Optimize data storage, query performance, and cost efficiency within cloud and big-data environments.
• Develop, test, and maintain data transformations using SQL and PySpark (Python) on Databricks.
• Enable reporting and dashboards through Amazon QuickSight, ensuring trusted and actionable insights.
• Contribute to technical documentation, best practices, and team knowledge‑sharing to foster collaboration and a strong team culture.

Job responsibilities

What You'll Do

• Design, develop, and maintain scalable data pipelines and architectures using Databricks to support analytics, reporting, and operational use cases.
• Build and manage batch and streaming ingestion pipelines, leveraging AWS S3 as the foundational storage layer.
• Integrate and harmonize data from multiple systems to ensure accuracy, consistency, and timely availability.
• Partner with stakeholders to translate business and analytics requirements into robust data models and datasets.
• Implement and enforce data governance, quality, and security standards across the data platform.
• Optimize data storage, query performance, and cost efficiency within cloud and big-data environments.
• Develop, test, and maintain data transformations using SQL and PySpark (Python) on Databricks.
• Enable reporting and dashboards through Amazon QuickSight, ensuring trusted and actionable insights.
• Contribute to technical documentation, best practices, and team knowledge‑sharing to foster collaboration and a strong team culture.

What we offer

Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.

Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment - or even abroad in one of our global centers or client facilities!

Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.

Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.

Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.

Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we've been at the forefront of the digital revolution - helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.

You can find more information about how GlobalLogic processes your personal data and what your rights are in the Recruitment Privacy Notice.