Data Scientist III

BMC Software, Inc.

Santa Clara (CA)

Hybrid

USD 132,000 - 220,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

BMC Software is seeking an experienced Data Scientist to join the AMI team in a hybrid capacity in Santa Clara, CA. You will design, develop, evaluate, and improve AI/ML solutions for large-scale enterprise challenges, applying rigorous experimentation and MLOps practices to boost model quality and efficiency.

You will own defined DS initiatives, guide moderately complex tasks, collaborate with engineering for production readiness, and mentor junior Data Scientists, contributing to enterprise AI

Qualifications

  • 5–9 years of Data Science, ML, or Applied AI experience.
  • Bachelor's degree in ML/Statistics/Data Science, Physics, CS, or related field.
  • Strong Python with Pandas, NumPy, scikit-learn, and PyTorch/TF; SQL and data prep.
  • Solid understanding of statistical analysis, experimental design, ML validation.
  • Experience with LLM prompting, embeddings, and RAG concepts.
  • Familiarity with MLOps/LLMOps and reproducible experiments.
  • Experience with AWS and Kubernetes/OpenShift.
  • Clear communication and cross-functional collaboration; ability to mentor.
  • Ability to deliver moderately complex AI/ML initiatives and influence teams.

Responsibilities

  • Design, develop, evaluate, and improve AI/ML solutions for enterprise challenges.
  • Apply statistical rigor and reproducible experimentation; advance MLOps/LLMOps.
  • Lead defined Data Science initiatives and collaborate on production readiness.
  • Mentor junior Data Scientists and collaborate with AI Engineering.

Skills

Data Science
Machine Learning
Python
Pandas
NumPy
SQL

Education

Bachelor's degree in ML/Statistics/DS/CS

Tools

AWS
Kubernetes
OpenSearch
Elasticsearch

Job description

Description and Requirements

\"At BMC trust is not just a word - it's a way of life!\"

CareerArc Code

CA-MH

Hybrid

BMC empowers nearly 80% of the Forbes Global 100 to accelerate business value, faster than humanly possible. Our industry-leading portfolio unlocks human and machine potential to drive business growth, innovation, and sustainable success. BMC does this in a simple and optimized way by connecting people, systems, and data that power the world’s largest organizations so they can seize a competitive advantage.

We're looking for an experienced Data Scientist to join our AMI team. This hands‑on role combines Machine Learning, statistical modeling, Generative AI, Retrieval‑Augmented Generation (RAG), model evaluation, and applied AI experimentation for enterprise AI applications. AMI supports commercial AI providers and on‑premises models, with agents, MCP tools, and A2A interoperability delivered in partnership with AI Engineering.

About The Role

You will design, develop, evaluate, and improve AI/ML solutions that address enterprise business and technical challenges. You will apply statistical rigor, reproducible experimentation, and MLOps/LLMOps practices to improve model quality, RAG effectiveness, and AI application performance.

You will take ownership of defined Data Science initiatives, lead moderately complex or ambiguous modeling and evaluation tasks, collaborate with engineering teams on production readiness, and mentor less experienced Data Scientists.

Key Responsibilities
Machine Learning & Applied Data Science
  • Apply classification, regression, ranking, forecasting, clustering, and anomaly detection to enterprise AI and agentic use cases.
  • Develop and evaluate intent classification, semantic matching, agent/skill/tool ranking, and model‑routing techniques using traditional ML, embeddings, and LLM‑based approaches.
  • Apply statistical modeling to analyze execution latency, token usage, inference costs, workload trends, and resource requirements.
  • Use clustering and anomaly detection to identify recurring intents, unusual agent behavior, capability gaps, and execution regressions.
  • Conduct exploratory analysis, dataset preparation, feature engineering, hypothesis testing, and reproducible experiments.
Foundation Models, Prompting & Context Engineering
  • Evaluate commercial and self‑hosted open‑weight models for accuracy, instruction adherence, structured outputs, latency, and cost.
  • Develop and test prompt templates, few‑shot examples, tool‑calling prompts, and context assembly approaches.
  • Compare model alternatives for defined enterprise use cases and document quality, performance, and cost tradeoffs.
  • Collaborate with Senior Data Scientists and AI Engineering on model performance analysis and inference optimization.
Retrieval‑Augmented Generation (RAG)
  • Develop and evaluate document chunking, metadata, embedding, retrieval, reranking, and context selection strategies.
  • Compare vector, keyword/BM25, hybrid, and semantic retrieval approaches.
  • Measure retrieval effectiveness using Recall@K, Precision@K, nDCG, groundedness, faithfulness, and answer quality.
  • Investigate retrieval and generation failures and recommend improvements based on evaluation results.
  • Benchmark embedding and reranking models using representative enterprise datasets.
Model Fine‑Tuning & Adaptation
  • Support evaluation of prompting, RAG, supervised instruction fine‑tuning, and parameter‑efficient model adaptation approaches.
  • Prepare and validate instruction datasets, training examples, and holdout evaluation datasets.
  • Participate in SFT, LoRA, QLoRA, or comparable fine‑tuning experiments under appropriate technical guidance.
  • Compare adapted models against baseline models for accuracy, generalization, regressions, and operational cost.
  • Collaborate on validation and production handoff of fine‑tuned model artifacts.
Agentic AI, MCP & A2A
  • Apply modeling and evaluation techniques to intent classification, agent/skill discovery, tool selection, and routing effectiveness.
  • Evaluate task completion, tool‑call correctness, parameter extraction, delegation quality, and recovery behavior.
  • Understand agentic AI concepts, including planning, tool calling, MCP tools, A2A Agent Cards, skills, and task delegation.
  • Collaborate with AI Engineering to investigate model‑related issues affecting agentic workflows.
  • Contribute model‑based decision signals and evaluation approaches without owning agent runtime, MCP server, or A2A protocol implementation.
AI Evaluation & Experimentation
  • Develop evaluation datasets, golden test cases, holdout sets, and automated evaluation workflows.
  • Evaluate ML models, foundation models, prompts, RAG pipelines, fine‑tuned models, and agentic AI behaviors.
  • Apply statistical analysis, human evaluation, and LLM‑as‑judge approaches with appropriate calibration.
  • Track accuracy, relevance, groundedness, instruction following, task completion, latency, and cost.
  • Investigate evaluation failures and recommend improvements based on experimental evidence.
  • Support automated regression testing and production readiness validation.
MLOps, LLMOps & Model Lifecycle
  • Apply experiment tracking and versioning across datasets, code, model configurations, prompts, retrieval settings, metrics, and artifacts.
  • Develop and maintain reproducible model training, benchmarking, and evaluation workflows.
  • Use model registries, experiment tracking tools, and automated evaluation pipelines.
  • Contribute to model quality gates, regression testing, and release‑readiness checks.
  • Analyze model performance, quality drift, routing accuracy, latency, and inference cost signals.
  • Collaborate with engineering teams on model packaging, deployment handoffs, monitoring, and lifecycle management.
Must‑Have Skills & Experience
  • 5‑9 years of relevant Data Science, Machine Learning, or Applied AI experience.
  • Bachelor's degree in Machine Learning, Statistics, Data Science, Physics, Computer Science, or a related field, or equivalent education and industry experience.
  • Strong Python proficiency with Pandas, NumPy, scikit‑learn, and PyTorch or TensorFlow; SQL and practical data preparation skills.
  • Solid understanding of statistical analysis, experimental design, hypothesis testing, ML validation, classification, regression, ranking, clustering, forecasting, and anomaly detection.
  • Practical experience with LLM prompting, embeddings, model comparison, and RAG concepts, including chunking, retrieval, and reranking.
  • Familiarity with instruction for fine‑tuning, parameter‑efficient adaptation, or model customization techniques.
  • Experience developing evaluation datasets, automated quality metrics, and reproducible ML/LLM experiments.
  • Hands‑on experience with MLOps/LLMOps practices, including experiment tracking, dataset/model/prompt versioning, reproducible workflows, evaluation automation, and monitoring.
  • Working knowledge of agentic AI concepts, including agent planning, routing, tool calling, MCP, A2A, and multi‑agent patterns.
  • Understanding model latency, throughput, token usage, inference cost, and model performance tradeoffs.
  • Familiarity with AWS and/or Kubernetes or Red Hat OpenShift (OCP), and collaboration with engineering teams.
  • Clear communication, problem‑solving, cross‑functional collaboration, and ability to manage multiple priorities.
  • Demonstrated ability to deliver moderately complex AI/ML initiatives, make sound technical decisions, and mentor junior Data Scientists.
  • Experience contributing to reusable modeling, evaluation, or MLOps/LLMOps practices within project teams.
Nice‑to‑Have Skills
  • Experience with OpenSearch, Elasticsearch, FAISS, Milvus, pgvector, or similar retrieval platforms.
  • Exposure to LangGraph, OpenAI Agents SDK, Google ADK, CrewAI, or comparable agentic frameworks.
  • Familiarity with MLflow, Kubeflow, Ragas, DeepEval, OpenJudge, LangSmith, or similar MLOps/LLMOps and evaluation tools.
  • Exposure to instruction fine‑tuning, SFT, LoRA, QLoRA, or domain‑specific model adaptation.
  • Familiarity with vLLM, NVIDIA Triton, quantization, GPU memory considerations, or inference optimization.
  • Python backend APIs (FastAPI, Flask, or similar); OpenTelemetry and AI observability.
  • AI safety, prompt injection evaluation, privacy, responsible AI, and model governance.
  • Time‑series forecasting, causal inference, or anomaly detection in enterprise systems data.
  • Agile practices and Atlassian Jira/Confluence.
  • Master's degree in a related field.
Our commitment to you!

BMC’s culture is built around its people. We have 6000+ brilliant minds working together across the globe. You won’t be known just by your employee number, but for your true authentic self. BMC lets you be YOU!

BMC is committed to equal opportunity employment regardless of race, age, sex, creed, color, religion, citizenship status, sexual orientation, gender, gender expression, gender identity, national origin, disability, marital status, pregnancy, disabled veteran or status as a protected veteran. If you need a reasonable accommodation for any part of the application and hiring process, visit the accommodation request page.

BMC Software maintains a strict policy of not requesting any form of payment in exchange for employment opportunities, upholding a fair and ethical hiring process.

The annual base salary range represents the low and high end of the BMC salary range for this position. Actual salaries depend on a wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training, licensure, and certifications; and other business and organizational needs.

The range listed is just one component of BMC's employee compensation package. Other rewards may include a variable plan and country specific benefits.

At BMC, it is not typical for an individual to be hired at /near the top of the range. A reasonable estimate of the current range is $131,700 - $219,500

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Scientist III
Data Scientist III

BMC Software • Los Angeles (CA)

Remote
USD 132,000 - 220,000
Data Scientist III
Data Scientist III

BMC Software • California

Hybrid
USD 132,000 - 220,000
Senior Data Scientist
Senior Data Scientist

BMC Software, Inc. • New York (NY)

Remote
USD 153,000 - 255,000
Senior Data Scientist
Senior Data Scientist

BMC Software • Santa Clara (CA)

On-site
USD 153,000 - 255,000
Data Scientist III
Data Scientist III

BMC Software, Inc. • San Francisco (CA)

Remote
USD 132,000 - 220,000
Senior Forward Deployed Engineer
Senior Forward Deployed Engineer

BMC Software, Inc. • United States

Remote
USD 133,000 - 222,000
Senior Data Scientist
Senior Data Scientist

BMC Software, Inc. • United States

Hybrid
USD 153,000 - 255,000
Principal AI Engineer
Principal AI Engineer

BMC Software, Inc • Santa Clara (CA)

On-site
USD 198,000 - 330,000
Principal AI Engineer
Principal AI Engineer

BMC Software, Inc. • Santa Clara (CA)

On-site
USD 198,000 - 330,000
Senior Data Scientist
Senior Data Scientist

BMC Software, Inc. • United States

Remote
USD 153,000 - 255,000