Lead Data Engineer: Secure, AI-Driven Data Platform

Trusted Concepts, Inc.; Arlington (VA); On-site; USD 132,000 - 198,000; Full time

Job summary

Two Six Technologies is seeking an experienced Lead Data Engineer to join a cross-functional team in Arlington, VA, focusing on mission tracking with AI/ML enhancements. The role centers on designing secure data sharing across platforms, aligning storage strategies, and maintaining complex data models across many microservices.

Ideal candidates will have 6+ years in Python/Go, PostgreSQL, Elasticsearch, Kafka, Redis, and cloud-native tech like Kubernetes and AWS.

Qualifications

• 6+ years of professional software development experience in Python and/or Go in highly distributed environments.
• 4+ years of hands-on experience designing and optimizing relational schemas in PostgreSQL, alongside experience utilizing Elasticsearch.
• 3+ years of experience implementing and scaling event-driven architectures with distributed message brokers like Kafka, and leveraging Redis for high-speed caching.
• Eligibility to obtain and maintain a TS security clearance.

Responsibilities

• Partner across teams to design and support a seamless, decentralized, and secure data sharing framework across different platform instances.
• Work closely with backend and database teams to align storage strategies across relational, indexing, and specialized time-series engines.
• Maintain and align complex, multi-domain data models across dozens of microservices, ensuring data integrity and strict contract management.
• Collaborate with infrastructure and platform teams to scale data systems across bare-metal and cloud environments.
• Design and implement resilient data patterns (CQRS and secure store-and-forward) to guarantee data security and controlled access in a distributed microservices environment.

Skills

Python

Go (Golang)

Distributed systems

Security

Education

Bachelor’s degree in Computer Science or related field

Tools

PostgreSQL

Elasticsearch

Kafka

Redis

Kubernetes

AWS

Docker

Git

Job description

Two Six Technologies is seeking an experienced Lead Data Engineer to join a cross-functional team in Arlington, VA, focusing on mission tracking with AI/ML enhancements. The role centers on designing secure data sharing across platforms, aligning storage strategies, and maintaining complex data models across many microservices.

Ideal candidates will have 6+ years in Python/Go, PostgreSQL, Elasticsearch, Kafka, Redis, and cloud-native tech like Kubernetes and AWS.