Senior Software Engineer - TS/SCI+Poly, Scalable Spark AI

Grvty

Laurel (MD)

On-site

USD 150,000 - 250,000

Full time

31 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

GRVTY is seeking a Software Engineer with a TS/SCI + Poly clearance to join a top project in Laurel, MD. You will re-engineer a Toponomy-based hierarchical topic-modeling software stack for horizontal scaling using Apache Spark and implement algorithms that adapt to streaming content in a evolving topical hierarchy.

You will build infrastructure to track user interactions, register and evaluate embedding models, and transition between models while integrating LLM-based applications and various

Qualifications

  • Active TS/SCI with Polygraph Clearance required.
  • 14+ years experience as a SWE in similar scope projects required.
  • Bachelor’s degree in Computer Science or related discipline, or 4 years extra SWE experience may substitute for degree.
  • Strong experience with Python for performance-critical components.
  • Experience with resilient distributed systems and streaming architectures.
  • Experience with Apache Spark.
  • Experience with containerization technologies.
  • Experience with Kubernetes.
  • Experience with AWS.
  • Experience with relational databases (Clickhouse or Postgres) and non-relational databases (Accumulo and neo4j).
  • Experience with Elasticsearch.
  • Experience with building LLM-based applications.
  • Experience with architecting APIs.
  • Experience with graph databases and vector databases.
  • Experience with vector analysis.
  • Experience with vector store.
  • Knowledge of Agency infrastructure (warehouses, GMLearn).

Responsibilities

  • Re-engineer a Toponomy-based hierarchical topic-modeling software stack to support horizontal scaling with Apache Spark.
  • Implement research-developed algorithms that continuously incorporate streaming content into an evolving topical hierarchy.
  • Build infrastructure to track topics that users save, like, or dislike.
  • Develop mechanisms to register, evaluate, integrate, version, and transition between embedding models.

Skills

Python
Apache Spark
Kubernetes
AWS
Distributed systems
APIs
Graph databases
Vector databases
LLM-based apps
Elasticsearch
Vector analysis
Vector store
Agency infra

Education

Bachelor's degree in Computer Science
4 years SWE experience substitution for degree

Tools

Clickhouse
Postgres
Accumulo
neo4j
ElasticSearch
Apache Parquet

Job description

GRVTY is seeking a Software Engineer with a TS/SCI + Poly clearance to join a top project in Laurel, MD. You will re-engineer a Toponomy-based hierarchical topic-modeling software stack for horizontal scaling using Apache Spark and implement algorithms that adapt to streaming content in a evolving topical hierarchy.

You will build infrastructure to track user interactions, register and evaluate embedding models, and transition between models while integrating LLM-based applications and various

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer - Scalable AI & Data Systems TS/SCI
Senior Software Engineer - Scalable AI & Data Systems TS/SCI

CyberCore Technologies • Laurel (MD)

On-site
USD 206,000 - 245,000
Health Insurance
Dental and Vision Insurance
Life Insurance and Disability
+4
Software Engineer
Software Engineer

Grvty • Laurel (MD)

On-site
USD 150,000 - 250,000
Software Engineer: AWS, Kubernetes, APIs & Spark
Software Engineer: AWS, Kubernetes, APIs & Spark

Erias Ventures, LLC. • Laurel (MD)

On-site
USD 225,000 - 260,000
Above Market Pay
401k with vesting
Spot Bonuses
+13
Enterprise Software Engineer – AWS, Spark & ML Systems
Enterprise Software Engineer – AWS, Spark & ML Systems

Erias Ventures, LLC. • Laurel (MD)

On-site
USD 225,000 - 280,000
Above Market Hourly Pay
11% Roth or Traditional 401k with Vest
Spot Bonuses
+14
Cloud Software Engineer Level 2/3 (TS/SCI) – Spark & AI
Cloud Software Engineer Level 2/3 (TS/SCI) – Spark & AI

J&T Business Consulting • Laurel (MD)

On-site
USD 209,000 - 255,000
Health, Dental, Vision Insurance
Life Insurance & Disability
Paid Holidays and PTO
+2
Software Engineer (TS/SCI) – AI/ML & Spark Systems
Software Engineer (TS/SCI) – AI/ML & Spark Systems

J&T Business Consulting • Laurel (MD)

On-site
USD 206,000 - 245,000
Health, Dental, and Vision Insurance
Basic Life Insurance and Disability
Paid Holidays and PTO
+2
Senior Software Engineer (TS/SCI) Python, Spark & Kubernetes
Senior Software Engineer (TS/SCI) Python, Spark & Kubernetes

Akina, Inc. • Maryland

On-site
USD 219,000 - 268,000
PTO 24 days
Federal holidays 11
401k 10% match
+2
Software Engineer (Level 2 or Level 3) - TS/SCI Clearance with Full Scope Polygraph Required
Software Engineer (Level 2 or Level 3) - TS/SCI Clearance with Full Scope Polygraph Required

J&T Business Consulting • Laurel (MD)

On-site
USD 206,000 - 245,000
Health, Dental, and Vision Insurance
Basic Life Insurance and Disability
Paid Holidays and PTO
+2
Full Stack Developer (TS/SCI) - Cyber Analytics
Full Stack Developer (TS/SCI) - Cyber Analytics

GRVTY • Virginia

On-site
USD 150,000 - 250,000
Health plan (comprehensive)
Health Savings Account with company
Annual Paid Time Off
+6
Senior Software Engineer: Python, Spark, Kubernetes, TS/SCI
Senior Software Engineer: Python, Spark, Kubernetes, TS/SCI

Akina Inc • Annapolis (MD)

On-site
USD 206,000 - 251,000
PTO 24 days annually
11 federal holidays
401(k) employer contribution 10%
+2