Data Scientist III

BMC Software, Inc.; Northern (KY); Remote; USD 115,000 - 191,000; Full time

Job summary

BMC Software, Inc. is seeking a Data Scientist to join the Intelligent z Optimization & Transformation team (IZOT) for the AMI Platform. The role centers on enterprise-grade ML and Generative AI, with hands-on work on LLMs, RAG, prompt engineering, and production deployment.

This position is fully remote in the United States; visa sponsorship is not available. You will collaborate with domain experts to build evaluation frameworks, benchmarks, and governance for AI solutions.

Qualifications

• 6+ years of Data Science experience with ML and Generative AI.
• B.Sc. in Computer Science, Engineering, or related field.
• Experience with LLMs (OpenAI, Anthropic, Gemini, Llama, or equivalent).
• Hands-on with prompt engineering, RAG, LLM evaluation, and AI development.
• Experience designing performance metrics and evaluation frameworks for AI/ML systems.
• Familiarity with LangGraph/LangChain/CrewAI and related tooling.

Responsibilities

• Design and build ML and Generative AI solutions for complex business problems.
• Apply prompt engineering, RAG, and LLM evaluation in end-to-end AI apps.
• Develop benchmarks, datasets, and performance metrics for AI systems.
• Collaborate with domain experts to translate requirements into data-driven solutions.
• Contribute to governance, model validation, and deployment in production.

Skills

Data Science

Machine Learning

Generative AI

Python

LLMs

LangGraph

LangChain

SQL

Pandas

NumPy

PyTorch

TensorFlow

OpenShift

AWS

Education

B.Sc. in Computer Science or related field

Tools

LangGraph

LangChain

CrewAI

Langfuse

OpenTelemetry

MLflow

Kubeflow

Jira

Confluence

OpenShift

AWS

Job description

Description and Requirements

At BMC trust is not just a word - it's a way of life!

CareerArc Code CA-MH

Hybrid

BMC empowers nearly 80% of the Forbes Global 100 to accelerate business value, faster than humanly possible. Our industry-leading portfolio unlocks human and machine potential to drive business growth, innovation, and sustainable success. BMC does this in a simple and optimized way by connecting people, systems, and data that power the world’s largest organizations so they can seize a competitive advantage.

We’re looking for an experienced Data Scientist to join our Intelligent z Optimization & Transformation team (IZOT), specially for the AMI Platform team.

This role will be fully remote in the US. We’re unable to offer visa sponsorship at this stage.

In this role, you will design and build enterprise-grade Machine Learning and Generative AI solutions that solve complex business challenges. You'll work hands‑on with LLMs, RAG architecture, prompt engineering, and agentic AI frameworks, while defining how these systems are evaluated, optimized, and deployed in production environments.

Key Responsibilities

Machine Learning & Generative AI Development (core focus)

• Design and develop Machine Learning and Generative AI solutions for complex business problems, applying statistical analysis, data mining, and machine learning techniques.
• Apply prompt engineering, RAG, and LLM evaluation in end-to-end AI application development.
• Work on complex problems where analysis of situations or data requires an in-depth evaluation of several factors.
• Collaborate with domain experts to understand business requirements and formulate data driven solutions.

Evaluation, Governance & Enterprise Grade Quality

• Deliver solutions to enterprise grade quality standards: rigorous, validated, reproducible, and ready for mission critical use.
• Define and implement evaluation frameworks for agent accuracy, task completion, reliability, and user satisfaction.
• Develop benchmarks, test datasets, and performance metrics for agentic AI systems.
• Contribute to AI governance, model validation, and continuous improvement initiatives.

Model Optimization & Deployment

• Implement strategies for model optimization, considering the constraints and requirements of mainframe environments.
• Support packaging and deployment of models and AI solutions into production environments.

Collaboration & Communication

• Explain complex technical concepts and predictive analytics clearly to both technical and non-technical audiences.
• Contribute to code reviews, technical documentation, and best practices.

Required Experience

• 6+ years of Data Science experience, with proven expertise in Machine Learning and Generative AI.
• B.Sc. in Computer Science, Engineering, or a related field.
• Experience working with Large Language Models (OpenAI, Anthropic, Gemini, Llama, or equivalent), with familiarity across different LLM architectures.
• Hands on experience with prompt engineering, Retrieval Augmented Generation (RAG), LLM evaluation, and AI application development.
• Experience designing performance metrics and evaluation frameworks for AI/ML systems.
• Familiarity with agentic frameworks and agent-based workflows using LangGraph, LangChain, or CrewAI.
• Strong proficiency in writing Python backend APIs (using FastAPI, Flask or similar) and in data science libraries such as Pandas, NumPy, scikit-learn, and PyTorch or TensorFlow.
• Strong knowledge of statistical analysis, hypothesis testing, data mining, and machine learning techniques.
• Experience querying and analyzing data using SQL and modern data platforms.
• Proficiency in data exploration and data visualization techniques and tools.
• Familiarity with cloud platforms such as OpenShift (OCP) and AWS.
• Self-starter with intellectual curiosity; self-learner, flexible, and able to work in a multi tasked and dynamic environment.
• Excellent communication skills, with demonstrated ability to explain complex technical concepts and predictive analytics to non-technical audiences.

What Will Make You Stand Out

• Experience with LLM evaluation and observability tooling such as Langfuse, OpenTelemetry based stacks.
• Experience with vector databases and embedding models for retrieval and semantic search.
• Experience with MLOps practices such as experiment tracking, model registries, and pipelines (MLflow or Kubeflow).
• Experience with fine tuning and open weight models such as Llama, Mistral, and Qwen.
• Experience with Agile methodology and Atlassian products (Jira, Confluence).

Our Commitment to You

BMC’s culture is built around its people. We have 6000+ brilliant minds working together across the globe. You won’t be known just by your employee number, but for your true authentic self. BMC lets you be YOU!

We want to attract talents from diverse backgrounds and experience to ensure we face the world together with the best ideas!

BMC is committed to equal opportunity employment regardless of race, age, sex, creed, color, religion, citizenship status, sexual orientation, gender, gender expression, gender identity, national origin, disability, marital status, pregnancy, disabled veteran or status as a protected veteran. If you need a reasonable accommodation for any part of the application and hiring process, visit the accommodation request page.

The annual base salary range represents the low and high end of the BMC salary range for this position. Actual salaries depend on a wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training, licensure, and certifications; and other business and organizational needs.

The range listed is just one component of BMC's employee compensation package. Other rewards may include a variable plan and country specific benefits.

At BMC, it is not typical for an individual to be hired at /near the top of the range. A reasonable estimate of the current range is $114,525 - $190,875.