Data Scientist- Senior Associate

KPMG LLP; Montvale (NJ); On-site; USD 110,000 - 170,000; Full time

Job summary

KPMG LLP in the United States is seeking a Data Scientist to join our Audit Technology Alliance. You will develop and deploy generative AI components, including RAG pipelines and context engineering, within our established architecture.

Collaborate with product managers and engineers to translate requirements into production-ready code, prototype AI agents with LangChain, and contribute to the team's technical roadmap while mentoring junior data scientists.

Qualifications

• Three+ years in data science or ML engineering focusing on AI model deployment.
• Master's degree preferred in CS/Data Science; bachelor required.
• Experience with LLMs and frameworks (LangChain, Semantic Kernel) and AI applications.
• Proficient Python; familiarity with Azure, Databricks, Fabric.

Responsibilities

• Develop and implement core components of generative AI solutions including RAG pipelines and context engineering features within the established architecture.
• Collaborate with product managers, senior data scientists, and AI engineers to translate feature requirements into production-ready code and contribute to the team's objectives.
• Prototype AI agent and orchestration patterns using LangChain/LangGraph; drive innovation in solutions.

Skills

Data science

Python

LLMs

Azure

Git

Agile

Education

Bachelor's degree

Master's degree preferred

Tools

LangChain

Semantic Kernel

LangSmith

Databricks

Microsoft Fabric

Job description

KPMG is currently seeking a Data Scientist to join our Audit Technology Alliance organization.

Responsibilities:

• Develop and implement core components of generative AI solutions including RAG pipelines and context engineering features within the established architecture; drive quality into prompt engineering and optimization for business use cases
• Collaborate closely with product managers, senior data scientists, and AI engineers to translate feature requirements into production-ready code and contribute to the team's technical objectives
• Focus on continuous innovation by assisting in prototyping modern AI agent and orchestration patterns using frameworks like LangChain/LangGraph
• Drive the delivery of robust data science features by taking ownership of specific modules from development and experimentation through to deployment
• Engage in agile ceremonies and contribute to the team’s collective knowledge of generative AI, audit methodologies, and best practices
• Enhance AI and RAG evaluation frameworks using tools like LangSmith; ensure solutions meet KPMG's standards for quality
• Provide technical leadership and mentorship to junior data scientists; guide hands‑on work in context engineering, model tuning, and advanced data analysis
• Act with integrity, professionalism, and personal responsibility to uphold KPMG’s respectful and courteous work environment

Qualifications:

• Minimum three years of recent experience in data science, machine learning engineering, or a similar role with a focus on building and deploying AI models
• Master’s degree from an accredited college or university in computer science, data science, statistics, or a related technical field is preferred; minimum of a bachelor’s degree is required
• Experienced in working with LLMs, AI frameworks like LangChain or Semantic Kernel, and building AI-powered applications
• Strong programming skills in Python and its data science libraries; experience with Azure, Databricks, or Microsoft Fabric is a significant plus
• Proficient with SDLC tools and methodologies including Git, Azure DevOps, and working within an agile framework
• Excellent problem-solving skills; able to communicate technical details effectively within a collaborative team environment(200TEC)
• Applicants must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future; KPMG LLP will not sponsor applicants for U.S. work visa status for this opportunity (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa)