Data Engineer: Secure Data Pipelines for SOCOM

Clarityinnovates; Tampa (FL); On-site; USD 77,000 - 180,000; Full time

Job summary

Clarity Innovations is seeking a Data Engineer to support the U.S. Special Operations Command (SOCOM) at MacDill AFB, Florida. You will be embedded with SOCOM HQ providing data governance and modernization expertise to improve data-driven decision making for critical missions.

Responsibilities include building data pipelines, optimizing NoSQL/SQL systems, and integrating diverse data sources. A TS/SCI clearance is required to join this mission-focused team.

Qualifications

• Bachelor's degree in a STEM field, with preference to Computer Science and Software Engineering.
• Experience with data structures, databases, distributed computing, and API-driven architectures (SQL and NoSQL).
• Proficiency with modeling frameworks like UML, Agile development, and Git operations.
• Top Secret clearance with SCI eligibility is required.

Responsibilities

• Develop, maintain, and test data generation infrastructure to transform data from diverse sources.
• Create complex queries to optimize performance of NoSQL and big data infrastructure; maintain data pipelines.
• Build and maintain ETL pipelines from relational and NoSQL databases and APIs for data ingestion and integration.
• Configure data analytics frameworks and pipelines using NoSQL, SQL, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Hadoop, Kafka, Hive, and Pig.
• Apply distributed systems concepts such as consistency, availability, latency, durability, fault-tolerance, and consensus algorithms.
• Administrate cloud computing and CI/CD pipelines across Azure, Google Cloud, and AWS.
• Collaborate with product, data, and design teams to support data infrastructure needs.

Skills

SQL

NoSQL

APIs

Distributed computing

UML

Agile development

Git operations

Education

Bachelor's degree in STEM (CS/SE preferred)

Tools

Palantir Foundry

Azure

Google Cloud

AWS

MongoDB

Cassandra

Neo4j

Spark

Hadoop

Job description

Clarity Innovations is seeking a Data Engineer to support the U.S. Special Operations Command (SOCOM) at MacDill AFB, Florida. You will be embedded with SOCOM HQ providing data governance and modernization expertise to improve data-driven decision making for critical missions.

Responsibilities include building data pipelines, optimizing NoSQL/SQL systems, and integrating diverse data sources. A TS/SCI clearance is required to join this mission-focused team.