Global AI/ML Engineer Manager

Boston Consulting Group (BCG); Gurugram District; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

Boston Consulting Group (BCG) seeks an LLM Engineer to join a development team building and shipping LLM-powered features at scale. You will own backend services, APIs, and LLM systems, collaborating with global teams across time zones to deliver end-to-end solutions.

You will bring senior Python/API experience, NLP/ML grounding, and experience with LLM models and production-grade systems to a hands-on, autonomous role.

Qualifications

• Hands-on daily use of AI-assisted and agentic coding tools to write and refactor code
• Strong experience with Python, building REST APIs with frameworks like FastAPI
• Grounding in NLP/ML as they relate to LLM systems
• Experience with LLM models APIs (OpenAI, Anthropic)
• Experience deploying secure MCP servers at scale
• Understand multi-agent systems and applications in complex problem solving
• Designing end-to-end RAG systems: vector databases, semantic search, chunking strategy
• Experience with distributed search/indexing (Elasticsearch/OpenSearch/Solr)
• Prompt writing experience for various use cases
• Experience with Java or willingness to code in Java
• Experience with generative solutions in production at scale
• Server-side events and event-driven architectures
• Strong systems thinking and debugging skills
• Knowledge of backend security best practices

Responsibilities

• Build and ship LLM-powered features in a production, scalable application
• Own features end-to-end from concept to delivery
• Collaborate with Product Owners and stakeholders to solve complex problems
• Work cross-functionally across teams and time zones
• Continuously update technical skills and adopt new technologies
• Use data-driven approaches to solve engineering challenges
• Apply systems thinking integrating data science and engineering principles
• Take ownership of projects and deliver high-quality solutions independently

Skills

Python

LLM engineering

REST APIs

FastAPI

NLP basics

LLM APIs

Multi-agent systems

Security basics

Agentic coding tools

Distributed systems

Tools

OpenAI API

Anthropic API

LangChain

LlamaIndex

GitHub Copilot

Job description

Who We Are

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.

To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.

What You'll Do

The LLM Engineer will join an existing development team to build and ship LLM-powered features in a complex, production application used at scale. This is a hands‑on, full‑stack role spanning backend services, APIs, and the LLM systems (retrieval, agents, evaluation) that power them. You are expected to work as an agentic engineer—using AI coding tools and autonomous agents to write code, automate workflows, and optimize how the team delivers. You will collaborate with global teams across multiple time zones and own features end to end.

• Bring senior‑level Python and LLM engineering expertise to the team.
• Execute both planning and hands‑on technical work independently.
• Collaborate effectively with Product Owners and other stakeholders to solve complex problems.
• Work cross‑functionally to deliver impactful solutions across teams.
• Continuously develop your technical expertise and stay current with new technologies.
• Bring curiosity and drive to expand your skills and knowledge.
• Use a data‑driven approach to solve technical challenges and make informed decisions.
• Apply systems‑level thinking that integrates data science and engineering principles.
• Take full ownership of the features and projects you work on, delivering high‑quality solutions independently.

What You’ll Bring

• 2+ years of experience developing and experimenting with LLMs
• 8+ years of experience developing APIs with Python

Must‑Have Skills

• Hands‑on, daily use of AI‑assisted and agentic coding tools (e.g., Claude Code, Cursor, GitHub Copilot, autonomous coding agents) to write and refactor code, automate workflows, and optimize engineering processes.
• Strong experience with Python, particularly in building REST APIs using frameworks like FastAPI.
• Grounding in NLP and machine learning as they relate to building LLM systems
• Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic)
• Experience building, deploying, and securing MCP servers at scale.
• Understanding of multi‑agent systems and their applications in complex problem‑solving scenarios.
• Designing and implementing RAG systems end to end: vector databases, semantic search, retrieval quality, and chunking strategy.
• Experience with distributed search and indexing technologies (e.g., Elasticsearch, OpenSearch, Solr)
• Experience with prompt writing for various use cases
• Experience with Java or confidence in agentic coding skills to develop in Java
• Experience with generative solutions released to prod, at scale, beyond POCs
• Proficiency with server‑side events, event‑driven architectures, and messaging systems.
• Strong critical thinking and systems thinking skills, with experience debugging, optimizing, and making sound engineering decisions across complex backend systems, not just solving isolated problems.
• Solid understanding of security best practices for backend systems, including authentication and data protection.

Nice‑to‑Have Skills

• Experience with LLM guardrails
• Experience with LLM Frameworks (e.g. LangChain, LlamaIndex)
• Experience with LLM monitoring and observability
• Experience developing AI/ML technologies within large and business critical applications
• Building evaluation into LLM systems: eval harnesses, regression suites, LLM-as-judge, and offline/online quality metrics.

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.

BCG is an E - Verify Employer. Click here for more information on E-Verify.