Lead Data Integrations Engineer IRC302044

GlobalLogic; Hyderabad; On-site; INR 1,800,000 - 2,400,000; Full time

Benefits offered by this job

Exciting Projects

Collaborative Environment

Work-Life Balance

Professional Development

Excellent Benefits

Fun Perks

Job summary

GlobalLogic in Hyderabad, India is seeking a Lead Data Integrations Engineer with 10-15 years of data engineering experience to design and implement robust data ingestion pipelines. You will work on Databricks pipelines leveraging PySpark, Python, SQL and Snowflake, ensuring alignment with FDDs and source systems.

You will participate in hybrid work arrangements, collaborating across cross-functional teams to deliver scalable data solutions for diverse clients in high-tech sectors.

Qualifications

• 8+ years of relevant experience in data engineering and related fields, demonstrating a strong background in data ingestion.
• Hybrid work model combining remote and on-site collaboration to achieve project goals.

Responsibilities

• Reading and understanding customer requirements from Functional Design Documents (FDDs), including source systems, target schemas, and mapping instructions.
• Reconciling FDD requirements against actual source datasets from APIs, SFTP files, Snowflake tables, and other data sources.
• Translating reconciled requirements into production Databricks pipelines, including authoring configuration and data validation YAML files, and SQL, Python, and PySpark based mapping notebooks.
• Changes and fixes to existing customer pipelines and shared platform code.
• Root cause analysis and resolution of data discrepancies, pipeline failures, or validation issues.
• Clear in-code documentation and inline comments for complex or non-obvious transformation logic
• All work must adhere to Customer coding standards around formatting, structure, and inline documentation.

Skills

PySpark

Python

SQL

Tools

Databricks

Azure Data Factory

Snowflake

Apache Kafka

Job description

Lead Data Integrations Engineer IRC302044

Function

Software Product Engineering

Experience

10-15 years

Location

India - Hyderabad

Skills

Apache Kafka, azure data factory, Data Engineering & Pipeline Management: Databricks (Delta Lake, PySpark, Python, Snowflake, SQL

An organization in the high-tech sector focuses on delivering innovative software solutions that cater to diverse customer needs. The company specializes in advanced data engineering and analytics, providing services that enhance operational efficiency and drive business intelligence. Their technology capabilities include cloud-based infrastructure and robust data management tools, enabling clients to harness the power of data effectively. The organization plays a crucial role in supporting various industries by leveraging cutting-edge technology to facilitate data-driven decision-making.

Requirements

• 8+ years of relevant experience in data engineering and related fields, demonstrating a strong background in data ingestion.
• This role operates in a hybrid work model, combining both remote and on-site collaboration to achieve project goals.

Required Skills

• Foundational understanding of Snowflake and its functionalities for data warehousing.
• Basic knowledge of data engineering principles and pipeline management techniques.
• Strong hands on Experience with Databricks and Azure Data Factory for data ingestion tasks.
• Academic exposure to PySpark, Python and SQL for data transformationsfor data transformation workflows.

Preferred Skills

• Basic understanding of database concepts and management practices.
• Ability to use Cursor as IDE aor any other AI tool

Job responsibilities

• Reading and understanding customer requirements from Functional Design Documents (FDDs), including source systems, target schemas, and mapping instructions.
• Reconciling FDD requirements against actual source datasets from APIs, SFTP files, Snowflake tables, and other data sources.
• Translating reconciled requirements into production Databricks pipelines, including authoring configuration and data validation YAML files, and SQL, Python, and PySpark based mapping notebooks.
• Changes and fixes to existing customer pipelines and shared platform code.
• Root cause analysis and resolution of data discrepancies, pipeline failures, or validation issues.
• Clear in-code documentation and inline comments for complex or non-obvious transformation logic
• All work must adhere to Customer coding standards around formatting, structure, and inline documentation.

What we offer

• Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.
• Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!
• Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.
• Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.
• Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.
• Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!

About GlobalLogic

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most forward-thinking companies. Since 2000, we’ve been at the forefront of the digital revolution – helping create some of the most innovative and widely used digital products and experiences. Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products, platforms, and services.