Senior ML Engineer: Data & LLM Pipelines

Cisco Systems, Inc.; San Jose (CA); On-site; USD 203,000 - 259,000; Full time

Job summary

Cisco AI Research is seeking a Senior Machine Learning Engineer to build data and ML systems powering our LLMs and AI models. You will design scalable data pipelines, implement human-in-the-loop labeling workflows, and create synthetic data generation and evaluation methods to continuously improve dataset quality.

The role sits at the intersection of ML engineering and data engineering, collaborating with researchers and domain experts to determine data needs, productionize prototypes, and drive

Qualifications

• Bachelor’s degree in a STEM field with 7+ years of relevant experience.
• 2+ years of hands-on experience building, curating, and scaling datasets for ML training and evaluation.
• 3+ years of professional programming experience using Python, C++, or Go in production or research.
• 3+ years of experience using ML frameworks such as PyTorch or TensorFlow to develop, train, evaluate, and deploy models.

Responsibilities

• Design, build, and own end-to-end data pipelines for ML and LLM training, evaluation, and continuous model improvement.
• Build and improve human-in-the-loop data labeling pipelines, including data collection, task generation, annotation workflows, quality control, and feedback integration.
• Develop scalable approaches for synthetic data generation, augmentation, filtering, and validation to improve dataset quality, diversity, and coverage.
• Apply LLMs and ML techniques to automate data generation, labeling, filtering, scoring, and evaluation.
• Develop systems and metrics to measure dataset quality, including label quality, duplication, contamination, coverage, bias, and distribution shifts.
• Build reliable and scalable infrastructure for processing large volumes of data.
• Design experiments to understand how dataset quality affects model performance and drive improvements.
• Partner with researchers and ML engineers to develop datasets for training, fine-tuning, evaluation, and agent development.

Skills

Data pipelines

ML model evaluation

Human-in-the-loop labeling

Synthetic data generation

LLM/AI systems

Education

Bachelor's degree in STEM

Master's degree in STEM

PhD in STEM

Tools

Spark

Ray

Beam

Job description

Cisco AI Research is seeking a Senior Machine Learning Engineer to build data and ML systems powering our LLMs and AI models. You will design scalable data pipelines, implement human-in-the-loop labeling workflows, and create synthetic data generation and evaluation methods to continuously improve dataset quality.

The role sits at the intersection of ML engineering and data engineering, collaborating with researchers and domain experts to determine data needs, productionize prototypes, and drive