Data Engineering & AI Platform Architect_BFSI

Zorba AI

Bengaluru

On-site

INR 2,000,000 - 3,400,000

Full time

15 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Zorba AI in Bengaluru seeks an experienced Data Engineering & AI professional to build scalable, cloud-based data platforms and integrate Generative AI capabilities into enterprise solutions. The role requires hands-on Python, SQL, Spark/PySpark, and end-to-end pipeline development with exposure to LLMs, RAG architectures, and vector databases in a BFSI context.

Office four days a week. You will collaborate with Data Scientists and Solution Architects to deliver production-ready AI-enabled data

Qualifications

  • Strong hands-on Python and SQL required.
  • Spark/PySpark and distributed data processing experience.
  • End-to-end ETL/ELT pipelines, data ingestion and transformation.
  • Cloud platforms AWS/Azure/GCP.
  • LLM integration, RAG architectures, vector databases.
  • Lakehouse architecture and scalable data platform design.

Responsibilities

  • Design, develop, and maintain scalable end-to-end data engineering pipelines.
  • Build cloud-native data platforms supporting analytics, ML, and Generative AI apps.
  • Develop data ingestion, transformation, and integration using Python, SQL, Spark, PySpark.
  • Design distributed data processing frameworks and modern Lakehouse architectures.
  • Integrate enterprise data with LLMs and build Retrieval-Augmented Generation (RAG) solutions.
  • Work with vector databases to support AI-powered search and intelligent apps.
  • Leverage AWS/Azure/GCP and Databricks/Snowflake.
  • Implement data quality, governance, security, monitoring, and optimization.
  • Collaborate with Data Scientists, AI Engineers, and Solution Architects to deliver production-ready AI-enabled data solutions.
  • Support platform modernization, CI/CD, orchestration, and deployment activities.

Skills

Python
SQL
Spark/PySpark
ETL/ELT pipelines
LLM integration
RAG architecture
Vector databases
Databricks
Snowflake
Cloud platforms

Tools

Databricks
Snowflake

Job description

We are looking for an experienced Data Engineering & AI professional with strong expertise in building scalable, cloud-based data platforms and integrating AI/Generative AI capabilities into enterprise data solutions.

The ideal candidate should have hands-on experience in Python, SQL, Spark/PySpark, distributed data processing, and end-to-end data pipeline development, along with exposure to LLM integration, RAG architectures, and vector databases.

Candidates must have prior experience in the Banking, Financial Services, or Insurance domain.

Key Responsibilities
  • Design, develop, and maintain scalable end-to-end data engineering pipelines.
  • Build cloud-native data platforms supporting analytics, Machine Learning, and Generative AI applications.
  • Develop data ingestion, transformation, processing, and integration solutions using Python, SQL, Spark, and PySpark.
  • Design and implement distributed data processing frameworks and modern Lakehouse architectures.
  • Integrate enterprise data with Large Language Models (LLMs) and build Retrieval-Augmented Generation (RAG) solutions.
  • Work with vector databases to support AI-powered search and intelligent applications.
  • Leverage cloud platforms such as AWS, Azure, or GCP and data platforms such as Databricks or Snowflake.
  • Implement data quality, governance, security, monitoring, and performance optimization.
  • Collaborate with Data Scientists, AI Engineers, and Solution Architects to deliver production-ready AI-enabled data solutions.
  • Support platform modernization, CI/CD, orchestration, and deployment activities.
Mandatory Technical Skills
  • Programming: Strong hands-on experience in Python and SQL.
  • Big Data Technologies: Apache Spark / PySpark and distributed data processing.
  • Data Engineering: End-to-end ETL/ELT pipelines, data ingestion, transformation, and integration.
  • Cloud Technologies: AWS / Azure / GCP.
  • Data Platforms: Databricks / Snowflake.
  • AI / Generative AI: LLM integration, RAG architecture, and vector databases.
  • Data Architecture: Lakehouse architecture and scalable data platform design.
  • Production Engineering: CI/CD, orchestration, monitoring, data governance, and security.
BFSI Domain Experience – Mandatory

Candidates must have hands-on experience working in the Banking, Financial Services, or Insurance domain.

Relevant Experience Includes
  • Banking and customer/account data.
  • Financial transactions and payment processing.
  • Risk management and credit analytics.
  • Fraud detection and compliance.
  • Financial reporting and regulatory data.
  • Insurance and claims data.
Preferred Candidate Profiles
  • Senior Data Engineer
  • Lead Data Engineer
  • Data Platform Engineer
  • Data Engineering Architect
  • AI Data Engineer
  • AI Platform Engineer
Ideal Candidate

A hands-on Data Engineering professional with strong Python, SQL, and Spark/PySpark expertise, experience developing enterprise-scale data pipelines, and practical exposure to GenAI technologies such as LLMs, RAG, and vector databases.

The candidate must have BFSI domain experience and the ability to build secure, scalable, production-ready data platforms that enable enterprise AI applications.

Important Screening Criteria
  • 6–10 years of overall experience.
  • BFSI / Banking / Financial Services experience is mandatory.
  • Strong hands-on Python, SQL, and Spark/PySpark.
  • Experience developing end-to-end data pipelines.
  • Practical exposure to LLM integration, RAG, or vector databases.
  • Cloud experience in AWS / Azure / GCP.
  • Immediate to 30 days' notice period.
  • Comfortable working from office 4 days per week.

Skills: llm,aws,sql,azure,gcp,ci/cd,bfsi,python,gen ai

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Executive or Assistant Manager Data Engineering
Senior Executive or Assistant Manager Data Engineering

Mployee.me • Mumbai

On-site
INR 700,000 - 1,100,000
Senior Executive or Assistant Manager Data Engineering
Senior Executive or Assistant Manager Data Engineering

SMFG INDIA CREDIT COMPANY • Mumbai

On-site
INR 700,000 - 1,300,000
Gen AI Python Developer
Gen AI Python Developer

SID Global Solutions • Bengaluru

On-site
INR 400,000 - 900,000
AI Data Engineers
AI Data Engineers

Infosys • Dadri

On-site
INR 1,500,000 - 2,100,000
Data Engineer Staff
Data Engineer Staff

Hartford • Hyderabad

Hybrid
INR 1,200,000 - 2,000,000
Senior Python Developer
Senior Python Developer

SID Global Solutions • Bengaluru

On-site
INR 1,800,000 - 2,800,000
Lead Engineer - Data & AI
Lead Engineer - Data & AI

Quest Global • Bengaluru

On-site
INR 1,000,000 - 1,500,000
Senior Python Developer
Senior Python Developer

Mployee.me • Bengaluru

On-site
INR 2,500,000 - 4,200,000
AI Engineer (Gen AI, Databricks)
AI Engineer (Gen AI, Databricks)

Infosys • Bengaluru

On-site
INR 2,500,000 - 4,500,000
Data & AI Engineer
Data & AI Engineer

Aimpakt Mediatek • Mumbai

On-site
INR 1,800,000 - 3,000,000