Associate, Data Engineer, Transformation and Data

China, Beijing Branch; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

DBS Bank Hyderabad is seeking a data analytics professional to develop and optimize data extraction, transformation, and validation pipelines using Sparkola, PySpark, and SQL. The role involves building batch and ad-hoc pipelines, leveraging Cloudera Machine Learning, and ensuring data accuracy for downstream platforms like QlikSense and Superset.

You will collaborate with business users to translate requirements into technical solutions, participate in agile delivery with Jira, and maintain

Qualifications

• Strong hands-on experience with Sparkola
• Proficient in PySpark
• SQL skills including complex queries, joins and performance tuning
• Working knowledge of CML (Cloudera Machine Learning)
• Experience with Sparkola Job Server
• Familiarity with QlikSense and/or Superset
• Proficient MS Excel for data validation, analysis and reconciliation

Responsibilities

• Develop, enhance, and support data extraction, transformation, and validation using Sparkola, PySpark, and SQL.
• Build and manage batch and ad-hoc data pipelines via Sparkola Job Server.
• Utilize Cloudera Machine Learning for development, testing, and execution of Spark workloads as per DBS standards.
• Ensure datasets are accurate, traceable, and consumable by downstream analytics and reporting platforms like QlikSense and Superset.
• Engage with business users to translate requirements into data models and logic.
• Support production issues and data clarifications as required.
• Adhere to Jira-based delivery timelines and change controls.

Skills

Sparkola

PySpark

SQL (complex queries)

CML (Cloudera Machine Learning)

Sparkola Job Server

QlikSense

Superset

MS Excel

Tools

Sparkola

PySpark

SQL

CML

QlikSense

Superset

MS Excel

Job description

Business Function

Consumer Banking Group enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group CBG, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels

Key Accountabilities

• Develop, enhance, and support data extraction, transformation, and validation processes using Sparkola, PySpark, and SQL.
• Build and manage batch and ad‑hoc data pipelines through Sparkola Job Server, ensuring stability, performance, and timely delivery.
• Use Cloudera Machine Learning (CML) environments for development, testing, and execution of Spark workloads as per DBS standards.
• Ensure datasets are accurate, traceable, and fit for consumption by downstream analytics and reporting platforms such as QlikSense and Superset.

Business & Stakeholder Engagement

• Engage with business users and analysts to understand functional requirements and translate them into technical logic and data models.
• Support production issues and data clarifications as required.

Delivery Governance & Controls

• Manage deliverables using JIRA, adhering to timelines, priorities, and change control processes.
• Ensure solutions comply with DBS risk, security, and data governance standards, including internal data controls.

Required Skills for this rile (JD):

Technical Competencies

• Strong hands‑on experience with: Sparkola
• PySpark
• SQL (complex queries, joins, performance tuning)
• Working knowledge of: CML (Cloudera Machine Learning)
• Sparkola Job Server
• QlikSense and/or Superset
• Strong proficiency in MS Excel for data validation, analysis, and reconciliation.

Functional & Behavioral Competencies

• Experience working in agile delivery models with strong exposure to JIRA boards.
• Excellent communication and collaboration skills, with the ability to bridge business and technology discussions.
• Strong analytical thinking, attention to detail, and problem‑solving capability.
• Proactive, dependable team player with a learning mindset and resilience in a fast‑paced environment.

Preferred (Good to Have)

• Experience in banking or financial services, especially in regulated data environments.
• Exposure to data governance, audit, lineage, and controls.

Location: Hyderabad - DTI Skyview SEZ

Job: Analytics

Schedule: Regular

Employee Status: Full time