Senior Data Scientist: AWS SageMaker & Large-Scale LLMs

Machine Learning Technologies, LLC; San Jose (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

Machine Learning Technologies, LLC in the United States (San Jose) seeks a Senior Data Scientist / ML Engineer with AWS to build and deploy scalable AI solutions. You will work on data-to-training pipelines, large-scale SageMaker training, LoRA fine-tuning, and production inference, collaborating with customers and science teams to deliver high-impact models.

The role emphasizes data privacy, secure AWS workflows, and clear communication with stakeholders, with a 16+ month duration extension

Qualifications

• Must work with Spark (PySpark) and Hadoop ecosystem on large corpora.
• Experience with Amazon SageMaker AI: processing, distributed training, deployment.
• LLM fine-tuning (LoRA/QLoRA) and RL for ranking.
• Strong PyTorch fundamentals: architectures and training dynamics.
• Large-scale batch LLM inference and production inference.
• Data privacy and security on AWS: IAM, KMS, Lake Formation.
• Clear written communication with customers and stakeholders.

Responsibilities

• Data to training sets: turn unstructured and structured traveler and catalog data into narrative text documents and synthetic data, at a scale of tens of millions of documents.
• Feature and context engineering: decide what information goes into each document and how to express it.
• Large-scale distributed training on Amazon SageMaker AI, including HyperPod.
• Fine-tuning: LoRA/QLoRA adapters, supervised training, and reinforcement learning for ranking and reasoning.
• Deep learning modeling: model architecture, ranking heads, co-training and multi-task setups.
• Inference and deployment: low-latency, cost-efficient serving, including quantization, distillation and profiling.
• Evaluation and error analysis: build evaluation sets, run ablations and catch data leakage. Write up findings clearly for the customer and the AWS science team.
• Data privacy: handle customer data safely, including removing per

Skills

PySpark

Hadoop ecosystem

Hive

SageMaker

LoRA/QLoRA

PyTorch

LLM inference

Data privacy

Communication

Job description

Machine Learning Technologies, LLC in the United States (San Jose) seeks a Senior Data Scientist / ML Engineer with AWS to build and deploy scalable AI solutions. You will work on data-to-training pipelines, large-scale SageMaker training, LoRA fine-tuning, and production inference, collaborating with customers and science teams to deliver high-impact models.

The role emphasizes data privacy, secure AWS workflows, and clear communication with stakeholders, with a 16+ month duration extension