Lead Delivery AI Data Engineer

Boston Consulting Group (BCG); Gurgaon; On-site; INR 2,800,000 - 4,800,000; Full time

Job summary

Boston Consulting Group in Gurgaon is seeking a senior data engineer lead to own the design, building, and operation of production-grade data platforms and pipelines. You will lead end-to-end delivery for analytics and AI use cases, collaborating with consulting teams to translate business needs into scalable data solutions.

The role requires 8+ years in data engineering, strong Python/Java/Scala skills, and deep cloud and big data experience.

Qualifications

• Bachelor’s or Master’s degree in CS, Engineering, Technology, Data Science or related field.
• 8+ years of data engineering or enterprise AI delivery experience.
• Proven leadership of production-grade data engineering programs with hands-on involvement.
• Expert proficiency in Python, Java, or Scala.
• Strong cloud experience across AWS, Azure, or GCP.
• Experience with Spark, Databricks, Snowflake, Hive, Hadoop.
• GenAI patterns including RAG, retrieval pipelines, LLM app design.

Responsibilities

• Own design and operation of production-grade data platforms and pipelines across cloud, hybrid, and on-prem environments.
• Lead end-to-end data engineering delivery for analytics and AI use cases.
• Collaborate with case teams to gather requirements, design, develop, and deliver data/AI solutions.
• Mentor engineers and ensure code quality, governance, and production readiness.

Skills

Data engineering

Python

SQL

Spark

Cloud computing

NoSQL/Big Data

ETL pipelines

Java/Scala

Education

Bachelor's or Master's in CS/Engineering/Data Science

Tools

Databricks

Spark

Snowflake

DBT

Hive/Hadoop

Job description

Job Description:

Who We Are

Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.

To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. We work in a uniquely collaborative model across the firm and throughout all levels of the client organization, generating results that allow our clients to thrive.

We Are BCG X

We’re a diverse team of more than 3,000 tech experts united by a drive to make a difference. Working across industries and disciplines, we combine our experience and expertise to tackle the biggest challenges faced by society today. We go beyond what was once thought possible, creating new and innovative solutions to the world’s most complex problems. Leveraging BCG’s global network and partnerships with leading organizations, BCG X provides a stable ecosystem for talent to build game-changing businesses, products, and services from the ground up, all while growing their career. Together, we strive to create solutions that will positively impact the lives of millions.

What Youll Do

As a part of BCG’s X Delivery team you will work closely with consulting teams on a diverse range of advanced data and AI topics. You will have the opportunity to leverage analytical methodologies to deliver value to BCGs Consulting (case) teams and Practice Areas (domain) through providing subject matter expertise on Data engineering and accelerated execution support.

You will collaborate with case teams to gather requirements, specify, design, develop, deliver, and support data and AI solutions serving client needs. You will provide technical support through deeper understanding of relevant data management solutions and processes to build high quality and efficient analytics solutions.

YOURE GOOD AT

• Owning the design, build, and operation of production-grade data platforms and pipelines across cloud, hybrid, and on-premise environments.
• Leading end-to-end data engineering delivery across ingestion, transformation, data modeling, orchestration, serving and productionization for analytics and AI use cases.
• Architecting scalable batch, streaming, real-time, and API-driven data solutions that are reliable, maintainable, and fit for business-critical decisioning.
• Designing data foundations that are trusted and reusable with strong practices across data quality, governance, cataloging, lineage, and access control.
• Leading GenAI-enabled implementations with strong architectural judgment and hands‑on credibility across RAG, retrieval design, LLM application patterns, workflow design, evaluation and production deployment.
• Writing, reviewing and raising the bar on engineering work in Python, Java, or Scala, with strong depth in distributed data systems and modern data platforms.
• Building reusable data engineering assets and implementation patterns that accelerate delivery across client engagements.
• Translating ambiguous business problems into scalable data and AI engineering solutions in partnership with senior clients, BCG consulting teams, and cross-functional technical stakeholders.

Functional Skills:

• Communicate with clarity, confidence, and executive presence across senior client stakeholders, consulting teams, and technical teams.
• Lead tough conversations on trade‑offs, scope, delivery risk, platform choices, and implementation complexity with sound judgment and credibility.
• Bring a strong consulting mindset: structured problem solving, pragmatic decision‑making, and the ability to navigate ambiguity without losing momentum.
• Lead and mentor engineers with high standards for architecture, code quality, documentation, DevOps, governance and production readiness.

What Youll Bring

• Bachelor’s or Master’s degree in Computer Science, Engineering, Technology, Data Science or a related technical field.
• 8+ years of relevant experience in data engineering, data platforms, or enterprise AI/data solution delivery.
• Proven experience leading production‑grade data engineering programs, with hands‑on involvement in architecture, implementation, code review, deployment, and operationalization.
• Expert proficiency in at least one major programming language such as Python, Java, or Scala.
• Strong understanding of distributed computing and modern data platforms, including Spark-based processing, performance tuning, and large‑scale data system design.
• Deep experience with technologies such as Spark, DBT, Databricks, Snowflake, Hive, Hadoop or equivalent big data and analytics ecosystems.
• Strong cloud engineering experience across AWS, Azure, or GCP, with expertise in at least one cloud ecosystem.
• On‑ground exposure to GenAI implementation patterns, including RAG, retrieval pipelines, LLM application architecture, workflow design, evaluation, monitoring and deployment.
• Responsible use of AI tools across the SDLC to improve engineering productivity while maintaining quality, security and delivery accountability.
• Hands‑on experience building trusted data foundations, including data modeling, pipeline productization, orchestration, CI/CD, containerization and observability.
• Practical experience with data governance, metadata, cataloging, lineage, privacy and security in enterprise data environments.
• Strong client‑facing communication skills, with the ability to influence senior stakeholders and handle ambiguity, trade‑offs, and difficult delivery conversations.

Good to have:

• Prior consulting experience or experience working directly with senior stakeholders driving solution delivery.
• Experience in Retail, Telecom or other data‑rich industries with complex enterprise data landscapes.
• Experience with NoSQL, streaming, messaging and event‑driven architectures.
• Exposure to ML engineering or advanced analytics integration in production environments.
• Experience making pragmatic build‑versus‑buy recommendations across enterprise data and GenAI platforms.
• Good understanding of enterprise architecture transformations like Lakehouse and Data Mesh, along with its advantages and drawbacks.

Who Youll Work With

Our technology consultants and specialists partner with our clients and colleagues to build and implement digital solutions through a broad spectrum of activities. Technology jobs and engineering jobs include design of IT architectures, large-scale transformation, agile development, software engineering, cybersecurity consulting, and risk management.

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws. BCG is an E - Verify Employer. Click here for more information on E-Verify.