AI Data & Knowledge Engineer – Senior Associate

State Street; Bengaluru; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

State Street is seeking an AI Data & Knowledge Engineer to design scalable data pipelines, ETL/ELT workflows, and knowledge assets powering enterprise AI use cases. The role involves big data processing, data integration, retrieval pipelines, and building knowledge graph foundations under guidance from senior engineers.

You will contribute to RAG pipelines, vector indexing, and semantic enrichment while collaborating in a team environment to ensure data quality and governance across batches and

Qualifications

• Bachelor's degree in CS, Data Engineering, Information Systems, or related field.
• 0–7 years of experience in data engineering, software engineering, or related technical role.
• Proficiency in Python and SQL and/or Java.

Responsibilities

• Build and maintain backend data pipelines to ingest, transform, and serve data for AI apps.
• Support ETL/ELT workflows across enterprise data platforms.
• Assist in developing RAG pipelines, vector indexing, and knowledge graph assets.

Skills

Python

SQL

Java

Big data

Education

Bachelor's degree in Computer Science / Data Engineering / Information Systems

Tools

Spark

Databricks

Airflow

Job description

About The Role

We are looking for an AI Data & Knowledge Engineer with a strong foundation in data engineering and an interest in AI-powered data systems. This role will help build and maintain scalable backend data pipelines, ETL/ELT workflows, and structured knowledge assets that power enterprise AI applications. The ideal candidate will contribute to big data processing, data integration, retrieval pipelines, and knowledge graph foundations that enable reliable GenAI use cases.

We are looking for an AI Data & Knowledge Engineer with a strong foundation in data engineering and an interest in AI-powered data systems. This role will help build and maintain scalable backend data pipelines, ETL/ELT workflows, and structured knowledge assets that power enterprise AI applications. The ideal candidate will contribute to big data processing, data integration, retrieval pipelines, and knowledge graph foundations that enable reliable GenAI use cases.

Key Responsibilities

• Build and maintain backend data pipelines to ingest, transform, and serve structured and unstructured data for AI applications.
• Support ETL/ELT workflows across enterprise source systems, data platforms, and downstream AI services.
• Assist in developing RAG pipelines, vector indexing workflows, and knowledge graph assets under guidance from senior engineers.
• Contribute to data modeling, ontology creation, metadata tagging, and semantic enrichment of enterprise data.
• Support MCP server integration and AI data enablement tasks for domain use cases.
• Perform data quality checks, validation, reconciliation, and documentation for pipelines and data contracts.
• Help optimize pipeline performance, reliability, and scalability across batch and near-real-time workloads.
• Participate in code reviews, sprint ceremonies, and engineering discussions to build platform and domain knowledge.

Required Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 0–7 years of experience in data engineering, software engineering, or a related technical role.
• Working knowledge of Python and SQL and/or Java.
• Basic understanding of ETL/ELT pipelines, data transformation, and data integration concepts.
• Exposure to big data or distributed processing tools such as Spark, Databricks, or similar platforms is preferred.
• Basic familiarity with data lakes, warehouses, or lakehouse architectures.
• Understanding of data quality, metadata, and governance concepts.
• Exposure to RAG, vector databases, semantic search, or knowledge graph concepts is a plus.
• Familiarity with orchestration tools such as Airflow or similar platforms is beneficial.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success. We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future. As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law. Discover more information on jobs at StateStreet.com/careers Read our CEO Statement Job ID: R-795624