Data Engineer - ETL/PySpark (Banking Domain)

Global Software Solutions Group; Bengaluru; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Global Software Solutions Group is seeking a hands-on Data Engineer in Bengaluru with strong PySpark and Python expertise to design, build, and maintain data marts and ETL pipelines within a banking environment. You will own the full SDLC from build through UAT, bug fixing, production deployment and postproduction support.

The role requires 5+ years in data-driven roles, expert Python and PySpark, Oracle SQL analytics, and solid data warehousing fundamentals.

Qualifications

• 5+ years commercial experience in a data-driven role.
• Hands-on experience building data marts and ETL pipelines.
• Expert level Python for ETL scripting.
• Strong PySpark experience.
• Analytical expertise in Oracle SQL and data analysis.
• Understanding of software engineering concepts and best practices for production pipelines.
• Banking client or banking domain knowledge.
• Strong Data Warehousing fundamentals.
• Familiarity with query languages and both SQL and NoSQL database technologies.
• CI/CD exposure, including testing and validation of data pipelines.

Responsibilities

• Design, build, and maintain ETL pipelines and data marts using PySpark and Python.
• Write clean, maintainable, and robust production-grade code.
• Own end to end SDLC activities: build, UAT, UAT bug fixes, production deployment, and postproduction support.
• Perform Oracle query analysis and PySpark code debugging.
• Work across structured, semi-structured, and unstructured data sources.
• Apply software engineering best practices to production pipelines.
• Support CI/CD processes and data testing/validation activities.

Skills

Python programming

PySpark

SQL

NoSQL databases

Data warehousing

CI/CD exposure

Banking domain knowledge

Oracle SQL

Tools

Hadoop

Hive

MapReduce

Jupyter

Pandas

NoSQL DBMS

Job description

Role Summary

We are looking for a hands-on Data Engineer with strong PySpark and Python expertise to build and maintain data marts and ETL pipelines within a banking environment. The ideal candidate owns the full SDLC, from build through UAT, bug fixing, production deployment and postproduction support.

Key Responsibilities

• Design, build, and maintain ETL pipelines and data marts using PySpark and Python
• Write clean, maintainable, and robust production-grade code
• Own end to end SDLC activities: build, UAT, UAT bug fixes, production deployment, and postproduction support
• Perform Oracle query analysis and PySpark code debugging
• Work across structured, semi structured, and unstructured data sources
• Apply software engineering best practices to production pipelines
• Support CI/CD processes and data testing/validation activities

Required Skills & Experience

• 5+ years commercial experience in a data-driven role
• Hands-on experience building data marts and ETL pipelines
• Expert level Python for ETL scripting
• Strong PySpark experience
• Analytical expertise in Oracle SQL and data analysis
• Understanding of software engineering concepts and best practices for production pipelines
• Banking client or banking domain knowledge
• Strong Data Warehousing fundamentals
• Familiarity with query languages and both SQL and NoSQL database technologies
• CI/CD exposure, including testing and validation of data pipelines

Daily Tech Stack

• Python
• Spark / PySpark
• Jupyter
• SQL and NoSQL DBMS
• Hadoop / MapReduce / Hive
• Pandas