LLM Research Engineer

Wal-Mart; Mountain View (CA); On-site; USD 158,000 - 180,000; Full time

Job summary

FocusKPI is seeking an LLM Research Engineer for a high-tech SaaS client in Mountain View, CA. This onsite, 12-month contract role centers on designing, training, and fine-tuning large language models and deploying them in production environments with MLOps practices.

You will work on cutting-edge NLP techniques, transformer architectures, and evaluation pipelines, contributing to open-source projects and research papers while collaborating with cross-functional teams.

Qualifications

• Master's degree with 3+ years of experience post-graduation or Bachelor's degree with 5+ years of experience post-graduation.
• Advanced degree in CS, AI, DS, or related field.
• Strong programming skills and ML proficiency.
• Proficiency with deep learning frameworks (TensorFlow, PyTorch, JAX).
• Experience with transformer-based models (GPT, BERT, RoBERTa, LLaMA).
• Familiarity with NLP and sequence-to-sequence models.
• Experience with Hugging Face libraries and OpenAI APIs.
• Experience with MLOps tools like Docker, Kubernetes, and CI/CD pipelines.
• Strong understanding of distributed computing and GPU acceleration (CUDA).
• Experience with evaluation pipeline development and LLM fine-tuning.
• Knowledge of RL and RLHF.

Responsibilities

• Design, train, and fine-tune large language models for various applications.
• Research NLP and ML techniques to improve model performance.
• Explore transformer architectures and multi-modal models.
• Prepare and preprocess large-scale text datasets.
• Develop data augmentation to improve training data quality.
• Ensure data bias is minimized and AI ethics are followed.
• Optimize model accuracy, efficiency, and scalability.
• Reduce latency and memory usage for real-time applications.
• Collaborate with MLOps to deploy LLMs in production with Docker/Kubernetes.
• Develop evaluation pipelines using accuracy, perplexity, BLEU, F1 scores.
• Test for bias, fairness, and robustness across datasets.
• Conduct A/B testing for model improvements in real-world tasks.
• Stay updated on generative AI, transformers, and NLP research.
• Contribute to papers, patents, and open-source projects.
• Present findings at conferences and internal sessions.

Skills

Strong programming

Machine Learning

Deep learning frameworks

Transformer models

NLP

Hugging Face

OpenAI APIs

MLOps tools

Docker

Kubernetes

CUDA GPU accel

Evaluation pipelines

RLHF

Education

Master's degree

Bachelor's degree

Tools

Docker

Kubernetes

CI/CD

Job description

FocusKPI is seeking anLLM Research Engineerto join one of our clients, a high-tech SaaS company. Looking for qualified candidates from high-tech companies.

Work Location: Mountain View, CA(Onsite role)

Duration: 12-monthcontract

Pay Range: $115 - 131/hr

No C2C resumes are considered

Responsibilities

• Design, train, and fine-tune large language models (e.g., GPT, LLaMA, PaLM) for various applications.
• Conduct research on cutting-edge techniques in natural language processing (NLP) and machine learning to improve model performance.
• Explore advancements in transformer architectures, multi-modal models, and emergent AI behaviors.
• Collect, clean, and preprocess large-scale text datasets from diverse sources.
• Develop and implement data augmentation techniques to improve training data quality.
• Ensure data is free from bias and aligned with ethical AI standards.
• Optimize model architecture to improve accuracy, efficiency, and scalability.
• Implement techniques to reduce latency, memory footprint, and inference time for real-time applications.
• Collaborate with MLOps teams to deploy LLMs into production environments using Docker, Kubernetes, and cloud
• Develop robust evaluation pipelines to measure model performance using key metrics like accuracy, perplexity, BLEU, and F1 score.
• Continuously test for bias, fairness, and robustness of language models across diverse datasets.
• Conduct A/B testing to evaluate model improvements in real-world applications.
• Stay updated with the latest advancements in generative AI, transformers, and NLP research.
• Contribute to research papers, patents, and open-source projects.
• Present findings and insights at conferences and internal knowledge-sharing sessions.

Qualifications

• Education: Master's degree with a minimum of 3+ years of experience post-graduation or a Bachelor'sdegree with a minimum of 5+ years of experience post-graduation
• Advanced degree in Computer Science, Artificial Intelligence, Data Science, or a related field.
• Strong programming skills.
• Proficiency with Machine Learning.
• Proficiency with deep learning frameworks such as TensorFlow, PyTorch, or JAX.
• Hands-on experience with transformer-based models (e.g., GPT, BERT, RoBERTa, LLaMA).
• Expertise in natural language processing (NLP) and sequence-to-sequence models.
• Familiarity with Hugging Face libraries and OpenAI APIs.
• Experience with MLOps tools like Docker, Kubernetes, and CI/CD pipelines.
• Strong understanding of distributed computing and GPU acceleration using CUDA.
• Experience with Evaluation Pipeline Development and Large Language Model Fine-Tuning.
• Knowledge of reinforcement learning and RLHF (Reinforcement Learning with Human Feedback).

Thank you!

FocusKPI Hiring Team

Founded in 2010, FocusKPI, Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley, California, with an East Coast office in Boston, Massachusetts.