Lead - Data Engineering

5100 Kyndryl Solutions Private Limited; Mumbai; Hybrid; INR 1,800,000 - 3,000,000; Full time

Benefits offered by this job

Hybrid work culture

Be Well program

Job summary

Kyndryl is seeking an AI Data Engineer to architect high‑performance data infrastructure powering autonomous systems. You’ll design the real‑time pipelines and vector embeddings that enable agentic AI across complex enterprise environments.

You will implement RAG pipelines, scale vector stores like Pinecone, Milvus or Weaviate, and build semantic layers with automated data guardrails to ensure data quality and safety in production.

Qualifications

• Expertise in ELK (ElasticSearch, Logstash, Kibana)
• Expertise in Python
• Experience with data mining, ETL and data pipelines
• Experience with relational and NoSQL databases (PostgreSQL, DB2, MongoDB)
• Excellent problem-solving, analytical and communication skills
• Ability to manage multiple projects with attention to detail
• Ability to translate technical requirements from business needs

Responsibilities

• Architect RAG pipelines and real-time data workflows
• Scale vector infrastructure for sub-second retrieval speeds
• Build semantic layers and knowledge graphs
• Create automated data guardrails for noise, bias, and PII
• Develop and maintain CI/CD pipelines for data infra

Skills

ELK stack

Python

Data mining

ETL

Data pipelines

Relational & NoSQL

PostgreSQL

DB2

MongoDB

Problem solving

Communication

Education

Degree in Computer Science/IT/Software Engineering

Tools

GitHub

Visual Studio

Job description

Who We Are

At Kyndryl, we run and reimagine the mission‑critical technology systems that drive advantage for the world’s leading businesses. We are at the heart of progress; with proven expertise and a continuous flow of AI‑powered insight, enabling smarter decisions, faster innovation, and a lasting competitive edge. For our people—Kyndryls—that means doing purposeful work that powers human progress. Join us and experience a flexible, supportive environment where your well‑being is prioritized and your potential can thrive.

Role

Your role As an AI Data Engineer at Kyndryl, you’ll be the architect behind the high‑performance data infrastructure that powers our autonomous systems. We aren't just moving tables; we’re building the real‑time pipelines that allow agentic AI to reason over the world’s most complex enterprise environments. Join Kyndryl and gain the trust, autonomy and teamwork to help define what comes next.

What you will do

• Architect for RAG: You’ll design and scale the pipelines for Retrieval‑Augmented Generation (RAG), transforming massive volumes of unstructured IT logs and documentation into optimized Vector Embeddings.
• Scale vector infrastructure: You will be responsible for the health and performance of our vector databases (e.g., Pinecone, Milvus, or Weaviate), ensuring sub‑second retrieval speeds for agentic reasoning loops.

Master Data Transformation

• Engineer semantic layers: Move beyond simple ETL to build knowledge graphs and semantic layers that provide agents with the necessary context to navigate complex infrastructure puzzles.
• Automate data excellence: Using a keen eye for detail, you’ll build automated data guardrails to detect noise, bias, or PII (Personally Identifiable Information) before it reaches the model, ensuring our AI remains safe and impactful.

Own the Backbone

• Solve meaningful challenges: Serve as the bridge between raw, messy data sources and deep technical AI work, identifying and resolving quality issues at the source.
• Progress to production: With a well‑defined methodology and software engineering prowess, you will build, deploy, and maintain the CI/CD pipelines for our data infrastructure, ensuring that our context window remains fresh and reliable.

Who You Are

Required skills and experience

• Expertise in ELK (ElasticSearch, Logstash, Kibana)
• Expertise in Phython
• Expertise in data mining, data storage and Extract‑Transform‑Load (ETL) processes
• Experience in data pipelines development and tooling
• Experience with both relational and NoSQL databases, PostgreSQL, DB2, MongoDB
• Excellent problem‑solving, analytical, and critical thinking skills
• Ability to manage multiple projects simultaneously, while maintaining a high level of attention to detail
• Ability to communicate with both technical and non‑technical colleagues, to derive and translate technical requirements from business needs

Preferred skills and experience

• Experience working as a ELK Observability SME / Data Engineer
• Experience in Data Modelling, to create conceptual model of how data is connected and how it will be used in business processes
• Professional certification, e.g. Open Certified Technical Specialist with Data Engineering Specialization
• Cloud platform certification, e.g. AWS Certified Data Analytics – Specialty, Elastic Certified Engineer, Google Cloud Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate
• Understanding of social coding and Integrated Development Environments, e.g. GitHub and Visual Studio
• Degree in a scientific discipline, such as Computer Science, Software Engineering, or Information Technology

Being You

The “Kyn” in Kyndryl means kinship, which represents the strong bonds we have with each other, our customers and our communities. We focus on ensuring all Kyndryls feel included and we welcome people of all cultures, backgrounds, and experiences. Even if you don’t meet every requirement, we encourage you to apply. We believe in growth, and we’re excited to see what you can bring. At Kyndryl, employee feedback has told us that our number one driver of employee engagement is belonging. That sense of belonging — being a valued, respected, trusted member of the team — is fundamental to our culture and fueling great experiences for our customers. This dedication to welcoming everyone into our company means that Kyndryl gives you the ability to thrive and contribute to our culture of empathy and shared success. That’s The Kyndryl Way.

What You Can Expect

Your career with us isn’t just a job—it’s an adventure with purpose. We offer a dynamic, hybrid‑friendly culture that supports your well‑being and empowers you to grow. Our Be Well programs are thoughtfully designed to support your financial, mental, physical, and social health—because we know that when you feel your best, you do your best. From your very first day, you’ll dive into impactful work that powers the systems our customers rely on every day. You won’t just contribute—you’ll make a difference, tackling meaningful projects that sharpen your skills and fuel your growth. We’re here to champion your journey. With powerful tools to chart your career path, personalized development goals aligned with your ambitions, and continuous feedback to keep you inspired and on track, you’ll have everything you need to thrive and evolve. You’ll develop in‑demand skills to grow your career and achieve your ambitions with access to cutting‑edge learning opportunities—from certifications with Microsoft, Google, and Amazon to coaching and hands‑on experiences. And through it all, you’ll be part of a culture that values empathy, restless learning, and a devotion to shared success. We want you to thrive here—and we’re committed to helping you do just that.

Ready to make an impact? Join us and help shape what’s next.