Principal AI/ML Engineer (Large Language Model) (TS/SCI) {S}

ARKA; King of Prussia (PA); On-site; USD 190,000 - 240,000; Full time

Benefits offered by this job

401k retirement plan

HSA contributions

Vacation accrual

Paid holidays

Tuition assistance

Annual bonus

Life insurance

Parental Leave

Employee assistance program

Job summary

ARKA Group L.P. is seeking a Principal AI/ML Engineer in King of Prussia, PA to lead a multidisciplinary team building AI/ML solutions for defense and commercial space.

You will drive development of LLM applications, fine-tuning models, and deploying solutions across cloud and on-premise resources. Candidates should have 10+ years in software or data science, strong Python and ML library experience, security clearance (TS/SCI), and experience with LangChain, Weaviate, PEFT, Docker/Kubernetes,

Qualifications

• BS in machine learning, computer science, mathematics or related field.
• 10+ years of experience; 2+ years building LLM applications.
• Experience with Python and ML libraries (PyTorch, TensorFlow, Keras, OpenCV, NumPy, Pandas, Polars, scikit-learn).
• Active TS/SCI U.S. Government Security Clearance.

Responsibilities

• Lead and mentor a multidisciplined team of developers and researchers on ML algorithms.
• Apply LLMs to remote sensing tasks, tasking collections, and analysis.
• Fine tune foundation models and build adapters (PEFT, llama factory).
• Use RAG with vector databases (Weaviate).
• Build apps with LangChain, DSPy; deploy via Kubernetes and cloud/local resources.
• Analyze large multi-domain data to extract actionable insights; review publications.
• Interface with leadership to report status.

Skills

Python

Data science libraries

PyTorch

TensorFlow

Keras

OpenCV

NumPy

Pandas

Polars

scikit-learn

Linux

AWS (EC2, S3, Lambda)

Docker

Kubernetes

CUDA

LangChain

DSPy

Weaviate

PEFT

llama.cpp

vllm

Rancher

TS/SCI clearance

Education

BS in machine learning, computer science, mathematics

MS or PhD in machine learning, computer science, mathematics

Tools

Weaviate

LangChain

DSPy

llama factory

PEFT

llama.cpp

vllm

Docker

Kubernetes

LangChain

AWS Bedrock / OpenAI

Job description

Job Category: ENG

Requisition Number: PRINC002819

• Posted : April 5, 2025
• Full-Time
• On-site

Locations

Showing 1 location

King Of Prussia, PA 19406, USA

Description

ARKA Group L.P. (“ARKA”) is an advanced technologies company serving the U.S. military, intelligence community, and commercial space industry delivering next-generation solutions to support the national security space enterprise. Built on more than six decades of excellence, ARKA brings modern approaches and a culture of innovation to the challenges of today.

Join the ARKA team to learn how Beyond Begins Here. Discover your next career opportunity now!

Position Overview:

The Principal AI/ML Engineer will support the development of AI/ML algorithms in a multitude of disciplines from object detection/classification, natural language processing, reinforcement learning, and large language models.

We offer generous relocation benefits for eligible candidates.

In support of work/life balance, many positions are available for a flexible schedule within the pay period. Ask us about the opportunity for flex scheduling if that’s of interest to you.

Responsibilities:

Lead and mentor a multidisciplined team consisting of developers and researchers to implement machine learning algorithms to solve a broad set of challenges for our various customers

• Apply Large Language Models (LLMs) to a variety of applications within remote sensing such as tasking collections, identifying gaps in collection plans, analyzing patterns of life, and more.
• Fine tune foundation models and building adaptors for new applications (llama factory, PEFT)
• Apply retrieval augmented generation (RAG) techniques to data to populate and query vector databases (e.g. Weaviate)
• Build custom applications with LLM frameworks such as LangChain, DSPy
• Deploy LLM solutions across cloud-based and local resources using kubernetes (llama.ccp, vllm etc)
• Analyze large multi-domain datasets such as images, text and/or graph data, to identify statistically relevant features to build models that provide analysts with actionable data
• Review relevant publications to understand and apply cutting edge concepts to defense and commercial applications
• Interface with both internal and external leadership to communicate technical status

Required Qualifications:

• BS in machine learning, computer science, mathematics, or related fields.
• 10+ years of experience, preferably in software development or as a data scientist with 2+ years of building LLM applications using some of the following:
  • Fine-tuning foundational models
    • Steering Techniques (e.g Sparse auto encoders, representation tuning)
    • Building adapters to use foundational models (e.g. PEFT, llama factory)
  • Prompt engineering techniques / Inference time techniques (e.g. chain of thought, tree of thoughts, etc.)
  • Using Retrieval Augmented Generation techniques to populate and query vector databases (e.g. Weaviate, pinecone)
  • Using LLM Frameworks (e.g. LangChain, DSPy)
  • Using AI APIs ( e.g AWS Bedrock, OpenAI)
  • Using LLM deployment frameworks (eg llama.cpp, vllm, tgi)
  • Developing UIs with ReAct
• Experience leading an interdisciplinary team of researchers and software developers and working with a program manager to define project scope and schedule to ensure we meet project milestones as defined by our customers
• Experience with Python and data science / machine learning libraries (e.g. PyTorch, TensorFlow, Keras, OpenCV, NumPy, Pandas, Polars, scikit-learn, etc.)
• Active TS/SCI U.S. Government Security Clearance

Preferred Qualifications:

• MS or PhD in machine learning, computer science, mathematics, or related fields.
• Experience leading an interdisciplinary team of researchers and software developers
• Experience with any of the following Computer Vision domains:
  • Large Language Models and experience identifying ways to incorporate them into new areas and applications
  • Applying Transformer-based architectures to domains in other areas outside of Natural Language Processing (NLP) such as computer vision
  • Object detection algorithms such as YOLO and Faster-RCNN
  • Natural Language Processing algorithms such as BERT
  • Generative Adversarial Networks and Variational Autoencoders
  • Reinforcement learning and familiarity with Gymnasium Gym, RLlib, and Stable Baselines
  • Applying clustering algorithms and/or deep neural networks to real life problems
  • Implementing tracking and pattern-of-life algorithms
• Experience with Machine Learning libraries and frameworks such as HuggingFace and LangChain
• Experience with Computer Vision libraries such as OpenCV, Nerfstudio, FiftyOne, etc.
• Experience with Linux
• Familiarity with using AWS cloud computing resources such as EC2, S3, Lambda, etc.
• Experience with any of the following additional languages: Java, C++, Rust, Go, and/or C#
• Experience implementing algorithms on the GPU in Python or C++ using CUDA and other CUDA libraries
• Experience with implementing tracking and pattern-of-life algorithms
• Experience in application deployment, virtualization, and containerization (e.g. Podman, Docker, Kubernetes, Rancher)
• Experience working with various Remote Sensing datasets (e.g. EO/OPIR/SAR images, passive RF, etc.)
• Experience shaping and writing proposals

Location: King of Prussia, PA

Situated less than an hour outside of Philadelphia and hosting the largest mall on the east coast, King of Prussia offers the urban feel sought in the city, while also giving opportunities to experience the beauty and history found only in Pennsylvania.

What We Offer:

• Company contributions to qualified HSA accounts
• 401k retirement plan with industry leading company contributions
• 3 weeks of vacation accrual per year plus time off for sick leave and unscheduled life events
• 13 paid holidays
• Upfront tuition assistance for approved degree programs
• Annual bonus program based on company and employee performance
• Company paid life insurance, AD&D, Short-Term and Long-Term disability insurance
• 4 weeks paid Parental Leave
• Employee assistance program (EAP)

This job operates in a professional office environment. While performing the duties of this job, the employee routinely is required to use hands to keyboard, communicate, listen to, and interpret instructions and remain stationary for extended periods of the time. This would require the ability to move around the campus and occasionally move/lift items weighing up to 25 lbs. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions of the job.

ITC & Security Clearance Requirements:

This position requires an active TS/SCI U.S. Government Security Clearance.

Visa Restrictions:

No visa sponsorship is available for this position.

Pre-employment Screenings:

Employment with any ARKA companies in the U.S. is contingent upon satisfactory completion of several pre-employment requirements to include a credit check, background check, and drug screen.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
This employer is required to notify all applicants of their rights pursuant to federal employment laws.For further information, please review the Know Your Rights notice from the Department of Labor.