Senior Data Engineer - AI & Python Solutions

Gartner India Research & Advisory Services Private Limited; Gurugram District; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Gartner India Research & Advisory Services Private Limited seeks a Senior Data Engineer to design Agentic AI ecosystems, leveraging Python, SQL, and AI techniques to enable intelligent, context-aware client interactions. You will architect multi-agent pipelines, implement RAG, and drive production-grade scalable solutions on AWS while collaborating with product and data science teams.

The role emphasizes building secure, high-performance digital assistants that connect client initiatives with

Qualifications

• 4–6 years of professional software engineering experience with production-grade code.
• Strong proficiency in Python app development including FastAPI and async programming.
• Hands-on experience building AI apps using orchestration frameworks (LangGraph/LangChain) and RAG with vector databases.
• Extensive experience deploying scalable AWS-based solutions (Lambda, ECS/EKS, API Gateway, DynamoDB).
• Experience taking systems from POC to high-availability production for large user bases.
• Excellent cross-time-zone collaboration and communication skills.
• Nice to have: LLM tuning/evaluation (prompt engineering, TruLens/RAGAS) and rule-based guardrails.

Responsibilities

• Architect and build Agentic multi-agent systems that autonomously retrieve and synthesize data sets.
• Develop robust RAG pipelines combining client priorities, history, and value metrics.
• Orchestrate workflows to connect dots across systems and hand off tasks to sub-agents or external APIs.
• Ensure enterprise-grade reliability with guardrails, security, and intent recognition for sensitive data.
• Scale from concept to production, ensuring high availability for thousands of global users.
• Optimize LLM interactions for latency vs. cost without compromising quality.
• Mentor engineers and collaborate with Product Managers and Data Scientists.

Skills

Python

SQL

AI

FastAPI

LangGraph

LangChain

AWS

Docker

Kubernetes

API Gateway

DynamoDB

Terraform

Tools

LangGraph

LangChain

Terraform

Docker

Kubernetes

API Gateway

DynamoDB

AWS (Lambda/ECS/EKS)

Job description

Sr Data Engineer (Python, SQL, AI Solutions)

About this role:

Join our Agentic AI Applications team to build the next generation of Gartner’s Sales and Service Delivery enablement tools. In this role, you will architect a sophisticated Agentic AI ecosystem designed to act as a force multiplier for our associates, moving beyond simple chatbots to create context-aware digital partners. You will drive the development of a comprehensive intelligent digital assistant capable of "connecting the dots" between client initiatives, value delivery, past engagements & interactions, and our vast library of expert research. You will engineer solutions that leverage Retrieval-Augmented Generation (RAG), multi-agent orchestration, secure intent recognition and efficient context handling—ensuring our Sales and Service teams have a powerful, intelligent interface to navigate critical business data and be more productive and effective in their client interaction preparation and follow up workflows.

What you’ll do:

• Architect & Build Agentic Systems: Design and implement scalable, multi-agent architectures that autonomously retrieve, synthesize, and act upon complex data sets—including client intelligence, strategic priorities, and historical engagement & Interactions logs.
• Develop Advanced RAG Pipelines: Engineer robust Retrieval-Augmented Generation (RAG) solutions that aggregate diverse business intelligence—spanning strategic client priorities, communication history, and value metrics—to ensure the AI possesses a holistic, real-time understanding of the client relationship.
• Orchestrate Complex Workflows: Build the logic that "connects the dots" across disparate systems, enabling the digital assistant to hand off tasks to specialized sub‑agents or external APIs.
• Ensure Enterprise-Grade Reliability: Implement rigorous guardrails, security controls, and intent recognition layers to ensure the AI acts safely and accurately when handling sensitive data.
• Scale from Concept to Production: Lead the technical evolution of AI capabilities from experimental POCs to robust, high‑availability systems, ensuring the platform scales effortlessly to support thousands of global users.
• Optimize Performance & Cost: Fine‑tune LLM interactions and context window usage to balance latency, cost, and response quality, ensuring a seamless real‑time experience for Sales and Service users.
• Collaborate & Mentor: Partner closely with Product Managers and Data Scientists to translate high‑level business requirements into technical roadmaps, while mentoring junior engineers in best practices for AI application development.

What you’ll need:

• 4–6 years of professional software engineering experience, with a strong track record of shipping production‑quality code.
• Deep proficiency in Python application development, including Fast API, asynchronous programming and performance optimization.
• Hands‑on experience building AI applications using orchestration frameworks (specifically LangGraph or LangChain) and implementing Retrieval‑Augmented Generation (RAG) using Vector Databases.
• Strong experience designing and deploying scalable solutions on AWS (e.g., Lambda, ECS/EKS, API Gateway, DynamoDB) and a strong background in distributed systems, APIs, microservices, container orchestration etc.
• Experience transitioning complex systems from "Proof of Concept" (POC) to high‑availability production environments serving a large user base.
• Strong communication and collaboration skills to work effectively across time zones and global teams.
• Good to have LLM Tuning & Evaluation: Experience with prompt engineering strategies, evaluating LLM performance (using frameworks like RAGAS or TruLens), or fine‑tuning open‑source models (e.g., Llama).
• Infrastructure as Code: Familiarity with Terraform managing AWS infrastructure.
• DevOps Practices: Experience with CI/CD pipelines (e.g., Jenkins, GitHub Actions) and containerization (Docker/Kubernetes).

Who you are

• Effective time management skills and ability to meet deadlines.
• Excellent communication skills for interacting with both technical and business audiences.
• Strong organization, multitasking, and prioritization abilities.
• Willingness and aptitude to embrace new technologies and rapidly master new concepts.
• Intellectual curiosity and passion for technology, with a drive to stay current with emerging trends.
• Commitment to delivering high‑quality project work on time and within budget.

Who are we?

At Gartner, Inc. (NYSE:IT), we guide the leaders who shape the world. Our mission relies on expert analysis and bold ideas to deliver actionable, objective business and technology insights, helping enterprise leaders and their teams succeed with their mission‑critical priorities. Since our founding in 1979, we’ve grown to 20,000 associates globally who support over 13,000 client enterprises in ~90 countries and territories. We do important, interesting and substantive work that matters. That’s why we hire associates with the intellectual curiosity, energy and drive to want to make a difference. The bar is unapologetically high. So is the impact you can have here.

What makes Gartner a great place to work?

Our vast, virtually untapped market potential offers limitless opportunities – opportunities that may not even exist right now – for you to grow professionally and flourish personally. How far you go is driven by your passion and performance. We hire remarkable people who collaborate and win as a team. Together, our singular, unifying goal is to deliver results for our clients. Our teams are inclusive and composed of individuals from different geographies, cultures, religions, ethnicities, races, genders, sexual orientations, abilities and generations. We invest in great leaders who bring out the best in you and the company, enabling us to multiply our impact and results. This is why, year after year, we are recognized worldwide as a great place to work.

Gartner is the world authority on AI

At Gartner, you’ll join a company at the very center of the AI revolution. Gartner has proactive, objective guidance throughout clients’ AI journeys. We set the standard for how organizations leverage artificial intelligence to drive meaningful impact. You’ll have access to unmatched resources, expertise, and technology, and play a key role in helping Gartner and our clients innovate and grow as we leverage AI to transform business and technology landscapes. It’s an exciting time to be at Gartner, with limitless opportunities to make a real impact, grow your skills, and build a lasting, meaningful career in a field that’s reshaping the way we operate. If you’re passionate about AI and want to be part of a team that’s guiding the leaders who shape the world, Gartner is the place for you.

What do we offer?

Gartner offers world‑class benefits, highly competitive compensation and disproportionate rewards for top performers. In our hybrid work environment, we provide the flexibility and support for you to thrive — working virtually when it's productive to do so and getting together with colleagues in a vibrant community that is purposeful, engaging and inspiring.

Equal Employment Opportunity

The policy of Gartner is to provide equal employment opportunities to all applicants and employees without regard to race, color, creed, religion, sex, sexual orientation, gender identity, marital status, citizenship status, age, national origin, ancestry, disability, veteran status or any other legally protected status and to seek to advance the principles of equal employment opportunity. Gartner is committed to being an Equal Opportunity Employer and offers opportunities to all job seekers, including job seekers with disabilities.

If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access the Company’s career webpage as a result of your disability. You may request reasonable accommodations by calling Human Resources at [phone] or by sending an email to [e-mail] .

Experience Level Senior Level