Principal LLM Application Engineer

ZipRecruiter; Palo Alto (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

An innovative company is seeking a Principal LLM Application Engineer to drive advancements in AI within cybersecurity. This role focuses on leveraging and optimizing Large Models (LLMs) to enhance customer experience through cutting-edge projects. Responsibilities include developing and optimizing LLMs, integrating advanced AI technologies, and collaborating with cross-functional teams. With significant growth opportunities, this position is perfect for those passionate about AI and machine learning. Join a forward-thinking firm at the forefront of technology, where your contributions will make a substantial impact on the future of threat detection and cybersecurity.

Benefits

Medical Insurance

Dental Insurance

Vision Insurance

Equity in the company

Qualifications

• 5+ years experience in natural language processing and machine learning.
• Strong problem-solving skills and creativity in applying LLMs.

Responsibilities

• Implement and fine-tune state-of-the-art Large Models for various applications.
• Collaborate with ML engineers and data scientists, providing guidance.

Skills

Natural Language Processing

Machine Learning

Data Science

Python

R

Deep Learning Frameworks

Problem-Solving

Analytical Skills

Cloud Infrastructure

DevOps/MLOps/LLMOps

Education

Bachelor's degree in Computer Science

Master's or PhD in Computer Science or AI

Tools

GPT-3+

LLAMA

Deep Learning Frameworks

Job description

Job Description

About AllyNd's Client

AllyNd's client is driving SOC transformation with its unique application of AI computing, initially focusing on generative AI-powered proactive threat research, threat analysis, and iterative threat hunting. The product's purpose-built agents respond to new threat actors and attack patterns within minutes, with agentic workflows delivering end-to-end threat detection and containment from integrated feeds of raw cyber threat advisories. Early users include prominent MSSPs and enterprise SOCs across retail, healthcare, SaaS, and technology sectors. The company is based in Palo Alto, CA, and is venture-funded by The Hive.

Job Description

The client is seeking to hire a Principal LLM Application Engineer. In this role, you will leverage and optimize Large Models (LLMs) and implement advanced AI technologies. You will work on cutting-edge projects, utilizing skills in GenAI, LLM, and ML Ops to enhance customer experience. This position offers significant growth opportunities at the forefront of AI within cybersecurity.

Responsibilities

1. Development and Optimization of LLMs: Implement and fine-tune state-of-the-art Large Models for various applications, focusing on performance and accuracy.
2. Evaluating Model Performance: Conduct rigorous assessments of LLMs to measure effectiveness, efficiency, and alignment with business goals.
3. Integration of Advanced AI Technologies: Implement Retrieval-Augmented Generation (RAG), function calling, and code interpreter technologies to enhance LLM capabilities.
4. Research and Development: Stay updated on the latest advancements in machine learning, especially in LLMs, LLM agents, and neural network training.
5. Data and Model Parallel Training: Use data and model parallelism techniques for efficient training of large-scale models.
6. Cross-Functional Collaboration and Leadership: Collaborate with ML engineers, data scientists, and product teams, providing guidance and mentorship.
7. Documentation and Reporting: Maintain detailed documentation of methodologies, models, and results; communicate findings across teams.
8. Contribute to Product Roadmap and Vision
9. Implement and Evaluate LLM Application Logic and Prompting Strategies: Stay current with field advancements.
10. Lead Incubation of New Initiatives and Architect Scalable Solutions: Drive strategic technology decisions to develop AI/ML capabilities within microservices architectures for clients.
11. Design, Test, and Deploy Machine Learning Models: Build scalable pipelines for batch and real-time applications, including large models.

Required Skills

• Bachelor's degree in Computer Science, Engineering, or related field.
• 5+ years experience in natural language processing, machine learning, or data science.
• Proficiency in Python or R.
• Experience with large models such as GPT-3+, LLAMA, or similar.
• Strong problem-solving skills and creativity in applying LLMs to products and services.
• Experience with deep learning frameworks.
• Deep theoretical or empirical understanding of deep learning.
• Experience in building, testing, and deploying large-scale machine learning models.
• Strong analytical and debugging skills.
• Familiarity with cloud infrastructure and distributed computing.
• Experience with DevOps/MLOps/LLMOps.
• Ability to address complex model training and optimization challenges.
• Effective communication skills for technical collaboration.
• Passion for staying updated on AI and machine learning trends.

Additional Skills

• Masters or PhD in Computer Science, AI, or related fields focusing on machine learning and NLP.
• Proficiency in Python or R programming.
• Experience in cybersecurity contexts.
• Experience developing GenAI solutions using RAG and LLM agentic applications.

Benefits

• Medical, Dental, and Vision insurance
• Equity in the company