Data Engineer

Amatriot Group, LLC; Chantilly (VA); On-site; USD 140,000 - 170,000; Full time

Job summary

Amatriot Group, LLC in Chantilly, VA seeks a Senior Data Engineer to build secure data pipelines, optimize large relational databases, and enable high-performance analytics of structured and semi-structured data. The role supports AI/GenAI workflows, multi-database architectures, and cross-domain integration while mentoring junior engineers.

The position demands strong SQL/ETL skills, experience with data security and performance tuning, and a TS-level clearance.

Qualifications

• Minimum 8 years of experience in data engineering, database design, or related fields.
• Experience working with structured and semi-structured data and visualization technologies.
• Experience improving data workflows, performance, and security.

Responsibilities

• Develop data processing workflows and analytics supporting desktop and web-based visual analytic tools.
• Support large-scale relational data analysis using visualization technologies and high-performance computing.
• Improve data workflows, system performance, and analytical efficiency.
• Support processing of structured, semi-structured, and unstructured data.
• Build secure data ingestion pipelines and integrate data sources with data warehouses.
• Design and optimize enterprise relational databases and implement data security standards.
• Design, create, and optimize automated ETL pipelines and multi-database architectures.
• Support AI/GenAI data engineering capabilities and cross-domain integration.
• Mentor junior team members and promote cross-team data standards.

Skills

8+ years experience

Structured data

Semi-structured data

Visualization technologies

Analytical skills

Communication skills

Tools

TypeScript

React

Python

FastAPI

LanceDB

Lance Graph

PostgreSQL

Temporal.io

Docker

Kubernetes

Job description

Career Opportunities with Amatriot Group, LLC

A great place to work.

Share with friends or Subscribe!

Are you ready for new challenges and new opportunities?

Join our team!

Current job opportunities are posted here as they become available.

Subscribe to our RSS feeds to receive instant updates as new positions become available.

Location: Chantilly, VA
Security Clearance: Active TS or higher [Required] Must be able to obtain CI Polygraph
Job Type: Full-Time
Target Salary Range*:$140,000 - $170,000

*This represents the potential salary range for this position depending on education level, years of experience and/or certifications in addition to other position specific requirements which may impact salary

Position Overview

The Data Engineer (Senior) supports advanced visual analytic applications by building secure data pipelines, designing and optimizing large relational databases, and enabling high-performance analysis of structured and semi-structured data.

This role improves data workflows, system performance, and secure data practices while supporting advanced AI/GenAI capabilities, multi-database architectures, cross-domain environments, and application integration. The Data Engineer (Senior) also mentors junior team members and contributes to cross-team engineering standards.

Key Responsibilities

Data Processing and Analytics

• Develop data processing workflows and analytics supporting desktop and web-based visual analytic tools.
• Support large-scale relational data analysis using visualization technologies and high-performance computing.
• Improve data workflows, system performance, and analytical efficiency.
• Support processing of structured, semi-structured, and unstructured data.

Data Ingestion and Integration

• Build secure data ingestion pipelines using open-source, COTS, and GOTS technologies.
• Integrate new data systems with existing data warehouses.
• Develop and optimize complex data parsing and streamlined ingestion processes.
• Support schema-aligned ingestion and normalization of diverse structured and unstructured data.
• Improve system performance and functionality across integrated data environments.

Database Design and Security

• Design and optimize enterprise relational databases.
• Establish standards for database operations and security.
• Support vector, graph, relational, and multi-database architectures.
• Implement Attribute-Based Access Control at the data layer.
• Support provenance and end-to-end data lineage tracking.
• Contribute to system optimization and security posture improvements.

ETL and Data Architecture

• Design, create, schedule, and optimize automated ETL pipelines.
• Support data architecture involving vector, graph, and multi-database orchestration.
• Support data modeling, transformation, integration, and normalization.
• Maintain traceability across complex data processing workflows.

AI and GenAI Data Engineering

• Support multi-model and multi-modality orchestration involving reasoning, perception, memory, and tool execution.
• Support temporal, spatial, geographic, quantitative, and computer vision AI implementations.
• Support Named Entity Recognition, contextual entity extraction, and entity resolution.
• Support multi-step retrieval and structured output generation.
• Enable deep source citation and traceable analytic outputs.
• Integrate data platforms with reasoning components, retrieval systems, databases, and AI/GenAI services.

Enterprise Infrastructure and Cross-Domain Support

• Support air-gapped, hybrid, and on-premises operational environments.
• Support container orchestration and distributed systems management using Kubernetes.
• Support locally hosted GPU servers and hyperconverged nodes.
• Support multitenant Cross-Domain Solutions.

Application Development and Integration

• Support UI, backend, and middleware engineering using TypeScript, React, Python, FastAPI, LanceDB, Lance Graph, PostgreSQL, Temporal.io, Docker, and Kubernetes.
• Integrate data services with application, retrieval, and AI/GenAI components.
• Support solutions using modern programming languages and frameworks.

Mentorship and Cross-Team Standards

• Mentor junior team members.
• Contribute to cross-team engineering and data standards.
• Promote consistent approaches to data architecture, processing, security, and performance.

Qualifications

Education

Experience

• Minimum 8 years of experience in data engineering, database design, or related fields. [Required]
• Experience working with structured and semi-structured data and visualization technologies. [Required]
• Experience improving data workflows, performance, and security. [Required]

Skills

• Strong skills in relational database design, SQL, and ETL/ELT processing. [Required]
• Familiarity with high-performance computing and mixed-technology environments. [Required]
• Strong analytical, communication, and collaboration skills. [Required]

Preferred Qualifications

• Experience supporting federal or secure, multi-enclave environments.
• Background with advanced visualization platforms or high-volume data processing.
• Knowledge of data modeling, warehousing, and performance tuning.