GCP,Bigquery,PubSub/Consultant Specialist

HSBC; Hyderabad; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

HSBC Software Development India is seeking an experienced Consultant Specialist to design and build scalable data platforms on Google Cloud Platform. You will work on real-time streaming and batch processing, using tools like Pub/Sub, Dataflow, BigQuery and Airflow.

You will mentor juniors, ensure data quality and governance, and collaborate with analysts to deliver dashboards in Looker/Qlik. A strong background in cloud data engineering and banking domain experience is preferred.

Qualifications

• Bachelor’s degree in computer science, engineering, or related field; Master’s preferred.
• 7+ years of professional data-engineering experience in batch and real-time streaming.
• Understanding of cloud security, governance and regulatory considerations.
• Familiarity with AI technologies and their banking applications.
• Proficiency in cloud computing, CI/CD, and SDLC.

Responsibilities

• Design and develop scalable data platforms and pipelines on Google Cloud Platform (GCP).
• Build and optimise real-time streaming solutions with Pub/Sub, Dataflow, Kafka or equivalent.
• Develop batch pipelines using BigQuery, Cloud Storage, Dataproc, Datastage, Composer/Airflow.
• Apply data quality, monitoring, testing, observability, security and governance practices.
• Create data models for operational reporting, analytics and BI use cases.
• Collaborate with analysts to deliver dashboards in Looker or Qlik.
• Demonstrate awareness of AI capabilities and responsible application.
• Provide technical leadership and promote automation and CI/CD.

Skills

Cloud data engineering

Streaming data

SQL

Python/Java

Data modeling

CI/CD

Education

Bachelor's degree in CS/Engineering

Master's degree preferred

Tools

BigQuery

Dataproc

Datastage

Composer/Airflow

Looker

Qlik

Pub/Sub

Dataflow

Kafka

Job description

Some careers shine brighter than others.

If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Consultant Specialist

In This Role, You Will

• Design and develop scalable, secure and reliable data platforms and pipelines on Google Cloud Platform (GCP) for both real-time and batch processing. Experience with data modelling, ETL/ELT, APIs and distributed systems.
• Build and optimise streaming solutions using technologies such as Pub/Sub, Dataflow, Kafka or equivalent, ensuring low latency, resilience and accurate data delivery. Proficiency in SQL and Python or Java
• Develop batch data pipelines using services such as BigQuery, Cloud Storage, Dataproc, Datastage, Composer/Airflow or equivalent orchestration and processing tools.
• Apply strong data-engineering practices, including data quality, monitoring, testing, observability, security, governance and performance optimisation.
• Create and maintain data models that support operational reporting, advanced analytics and business intelligence use cases.
• Partner with analysts and business stakeholders to deliver dashboards and insights using visualisation platforms such as Looker and Qlik.
• Demonstrate awareness of AI, machine learning and modern data-platform capabilities, and identify opportunities to apply them responsibly to business problems.
• Provide technical leadership and mentoring, contribute to architecture decisions, and promote automation, DevOps, CI/CD and continuous improvement across the data-engineering lifecycle.

To be successful in this role, you should meet the following requirements:

• Bachelor’s degree in computer science, Engineering, or a related field; Master’s degree preferred.
• 7+ years of professional data-engineering experience on batch and real-time event streaming.
• Understanding of cloud security, governance and regulatory considerations
• Familiarity with AI technologies and their application in banking or financial services.
• Technical acumen in cloud computing, CI/CD pipelines, and software development lifecycle.
• Ability to influence and drive changes within a complex organizational structure.
• Strong analytical skills to assess engineering practices and recommend improvements.

You’ll achieve more when you join HSBC.

www.hsbc.com/careers

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by – HSBC Software Development India