Senior Data Engineer

Absolute Business Solutions; Bethesda (MD); On-site; USD 125,000 - 255,000; Full time

Benefits offered by this job

401(k) with match

Paid time off

Health insurance

Referral program

Career development funds

Job summary

ABSC is seeking a mission-driven Senior Data Engineer to join our high-impact team supporting the National Digital Exploitation and Open Source Center. The role emphasizes building scalable data pipelines, Elasticsearch and graph-based platforms, and working with data scientists and infrastructure teams in a Kubernetes/cloud-native environment in Bethesda, MD.

Applicants must hold an Active Top Secret/SCI clearance with the ability to obtain a polygraph.

Qualifications

• Active Top Secret/SCI clearance with ability to obtain and maintain a Polygraph.
• Experience designing and optimizing Elasticsearch/OpenSearch indices for large hierarchical datasets.
• Experience with graph databases (JanusGraph, Neo4j, TigerGraph, Neptune or Memgraph).
• Strong data modeling for hierarchical and highly connected datasets.
• Experience with large-scale ETL/ELT pipelines and distributed storage systems.
• Proficiency in Python or Java for data engineering and automation.

Responsibilities

• Design, develop and optimize scalable data management solutions for analytics and AIML workloads.
• Build and maintain Elasticsearch and graph-based data platforms for large-scale hierarchical data.
• Develop scalable ingestion pipelines and data schemas to maximize query performance.
• Collaborate with data scientists and ML engineers to manage datasets throughout the data lifecycle.
• Participate in SAFe Agile development activities and ensure delivery of high quality software.

Skills

Elasticsearch/OpenSearch

Graph databases

Python/Java

Kubernetes

Data modeling

ETL/ELT

Distributed storage

Education

Bachelor's degree in Computer Science/Data Engineering or related field

Tools

JanusGraph

Neo4j

TigerGraph

Amazon Neptune

Memgraph

Kafka

Kubernetes

Terraform

CloudFormation

Job description

Absolute Business Solutions Corp ABSC is not just another tech company Were a community of innovators engineers analysts and business professionals working together with our customers to tackle the most complex challenges For more than 20 years weve supported critical Department of Defense DoD Intelligence Community IC Federal Civilian missions and global multi national corporations We specialize in supporting our clients in the Intelligence Technology Defense AIML and Data Science fields As we continue to grow at a rapid pace we need some amazing new professionals to join our team ABSC is seeking a mission driven Senior Data Engineer to join our high impact team supporting the National Digital Exploitation and Open Source Center NDOC DOMEX Technology Platform DTP In this role you will help improve data intelligence pipelines serving both Open Source Intelligence OSINT operations and document media exploitation for the Department of War DoW and the broader Intelligence Community IC Youll play a critical role in developing a future state AI managed DOMEX Data Discovery Platform D3P and DIA NDOCs mission While the work is primarily conducted on site at our client location in Bethesda MD we offer a flexible schedule and occasionally some tasks may be performed remotely Percentage of remote work will vary based on client requirementslogo delivables Security clearance required for this role An Active TSSCI with abilitywillingness to obtain a CI polygraph is required.

Responsibilities

• As a Senior Data Engineer you will design develop and optimize scalable data management solutions supporting advanced analytics and AIML workloads
• Working closely with data scientists software engineers and infrastructure teams you will build and maintain Elasticsearch and graph based data platforms that enable efficient storage discovery and analysis of complex hierarchical data
• Ability to become a POSTMAN power user to support the discovery of critical intelligence insights
• Design and optimize Elasticsearch indices to efficiently manage large scale hierarchical classification structures ensuring high performance search aggregation and update operations
• Design implement and maintain a graph data store supporting hierarchical graph structures optimized for large dense batch updates and high throughput analytics
• Develop scalable ingestion pipelines that support scalable graph analytics
• Design data schemas indexing strategies and partitioning approaches to maximize query performance scalability and storage efficiency
• Collaborate with infrastructure and platform engineering teams to deploy operate and optimize Elasticsearch and graph database services in a Kubernetes environment using cloud native technologies
• Partner with Data Scientists and AIML engineers to ingest curate manage analyze and securely expunge datasets throughout the data lifecycle
• Develop automated data loading transformation validation and quality assurance pipelines supporting production analytics workflows
• Optimize graph and search infrastructure for high availability resilience and performance under large scale analytical workloads
• Collaborate with software engineers and system architects to integrate graph and search services into microservice based applications
• Participate in SAFe Agile development activities including sprint planning design reviews architecture discussions and technical demonstrations
• Foster a culture of innovation collaboration and professional development within the team
• Ensure sound engineering practices compliance with policies and delivery of high quality software
• Coordinate with test teams to develop and monitor automated system integration tests
• Engage with cross functional teams to identify and develop high value integrations with other systemsapplications
• Provide specific input to the software components of system design to include hardwaresoftware trade offs software reuse use of COTSGOTS in place of new development and requirements analysis and synthesis from system level to individual software components

Requirements

• Bachelors degree in Computer Science Data Engineering or related field and 1215 years of relevant experience or Masters with 1013 years of experience
• Must possess an Active Top SecretSCI clearance and ability to obtain and maintain a Polygraph
• ElasticsearchOpenSearch architecture index design mappings analyzers and query optimization
• Graph databases such as JanusGraph Neo4j TigerGraph Amazon Neptune or Memgraph
• Data modeling for hierarchical and highly connected datasets
• Large scale ETLELT pipeline development
• Kubernetes deployment and operations for stateful data services
• Distributed storage systems and high volume data ingestion
• Python or Java for data engineering and automation

Desired Skills

• Experience supporting AIML and data science workflows
• Apache Kafka or similar streaming technologies
• Experience with Linux containerization CICD pipelines and Infrastructure as Code
• Graph analytics frameworks and algorithms including graph traversal centrality community detection similarity analysis and link prediction
• Experience with Keycloak and security best practices authNZ secrets management
• Experience building and maintaining microservices in Kubernetes
• Familiar with infrastructure as code CloudFormation Terraform Pulumi

Salary

Salary range for this requisition is 125k 255k annual

Company Overview

ABSC is a technology and services company that combines the agility of a small business with proven processes refined over more than two decades in business We specialize in supporting public sector clients in the Intelligence Defense Health and Safety areas Our team stands ready to deliver the next generation of programs personnel and solutions to help advance our federal government customers driving innovation agility and security across all mission areas

Benefits

• ABSC offers generous external referral bonuses
• You dont need to be an employee to benefit from our Referral Program
• ABSC is a proud V3 Virginia Values Vets member which recognizes our commitment to hiring Veterans
• Generous PTO plus 11 Federal Holidays
• Retirement Planning 401k Fully Vested with Match
• Annual Health and Wellness Allowance buy an Apple Watch a treadmill or hit the gym on us
• Career Development Annual Funds to spend on Education and Training
• Volunteer Time Off Annually all employees can spend 8 hours directly supporting a charity of choice
• Charitable Match ABSC matches an employees donation to a qualifying charity
• Referral Program We pay for internal and external referrals
• LOV Awards Earn bonus awards throughout the year from our Living Our Values awards program

Equal Opportunity Statement

Equal Opportunity Employer including veterans and individuals with disabilities