Senior Data Engineer

Clarity Innovations; Tampa (FL); On-site; USD 77,000 - 180,000; Full time

Job summary

Clarity Innovations is seeking a Data Engineer to support SOCOM at MacDill AFB in Florida. You will be embedded with SOCOM HQ to advance data governance and modernization efforts, focusing on data integration and analytics for mission-critical uses.

The role requires strong SQL/NoSQL, API integration, and distributed systems knowledge to build scalable pipelines with secure DevSecOps practices. TS/SCI eligibility helpful; on-site Tampa position.

Qualifications

• Bachelor's degree in a STEM field; CS/SE preferred.
• Verifiable experience with data structures, DBs, distributed computing, and API-driven architectures using SQL/NoSQL.
• Proficiency with UML, Agile, and Git operations.
• Top Secret clearance with SCI eligibility required.
• Minimum 1 year of relevant experience.

Responsibilities

• Develop, maintain, and test data generation infrastructures for diverse data sources.
• Write complex queries; optimize NoSQL/big data performance and data pipelines.
• ETL design to ingest data from SQL, NoSQL, and various APIs.
• Configure data frameworks with NoSQL/SQL, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, Spark, Hadoop, Kafka, Hive, Pig.
• Apply distributed systems concepts: consistency, availability, durability, fault tolerance.
• Administrate cloud and CI/CD pipelines across Azure, GCP, and AWS.
• Coordinate with product, data, and design teams to support data infrastructure needs.

Skills

Data engineering

SQL/NoSQL

APIs

Distributed computing

Cloud CI/CD

Education

Bachelor's degree in STEM

Tools

MongoDB

Cassandra

Neo4j

GraphDB

OrientDB

Spark

Hadoop

Kafka

Hive

Pig

HDInsight

Job description

Clarity Innovations is a trusted national security partner, dedicated to safeguarding our nation’s interests and delivering innovative solutions that empower the Intelligence Community (IC) and Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission success in an evolving world.

Our mission-first software and data engineering platform modernizes data operations, utilizing advanced workflows, CI/CD, and secure DevSecOps practices. We focus on challenges in Information Warfare, Cyber Operations, Operational Security, and Data Structuring, enabling end-to-end solutions that drive operational impact.

We are committed to delivering cutting‑edge tools and capabilities that address the most complex national security challenges, empowering our partners to stay ahead of emerging threats and ensuring the success of their critical missions. At Clarity, we are people‑focused and set on being a destination employer for top talent, offering an environment where innovation thrives, careers grow, and individuals are valued. Join us as we continue to lead innovation and tackle the most pressing challenges in national security.

Role

This Data Engineer directly supports the U.S. Special Operations Command (SOCOM) based at MacDill Air Force Base, Florida. Data Engineers in this program support the command through a combination of data governance and data modernization efforts. Data Engineers will be embedded within the SOCOM HQ to provide subject matter expertise and technical capability for integrating complex data used by the command. Data Engineers in this program support SOCOM's initiative to be more capable and effective when leveraging their data resources.

Responsibilities

A Data Engineer has a deep understanding of performance optimization and data pipelining. In addition to the baseline skills of a data analyst, data engineers can make raw data more useful for the enterprise. Senior Data Engineers can create and integrate application programming interfaces (APIs). Their technical skills generally include multiple programming languages and a deep knowledge of SQL database design.

This Data Engineer role requires a more in‑depth knowledge in programming for integrating complex models and using advanced software library frameworks to distribute large, clustered data sets. Data engineers collect and arrange data in a form that is useful for analytics. A basic knowledge in machine learning is also required to build efficient and accurate data pipelines to meet the needs for downstream users such as data scientists to create the models and analytics that produce insight.

The Data Engineer shall perform the following tasks:

• Developing, maintaining, and testing infrastructures for data generation to transform data from various structured and unstructured data sources.
• Develop complex queries to ensure accessibility while optimizing the performance of NoSQL and or big data infrastructure. Create and maintain optimal data pipeline architecture.
• Build and maintain the infrastructure to support extraction, transformation, and loading (ETL) of data from a wide variety of data sources. Extract data from multiple data sources, relational SQL and NoSQL databases, and other platform APIs, for data ingestion and integration.
• Configure and manage data analytic frameworks and pipelines using databases and tools such as NoSQL, SQL, HDInsight, MongoDB, Cassandra, Neo4j, GraphDB, OrientDB, Spark, Hadoop, Kafka, Hive, and Pig.
• Apply distributed systems concepts and principles such as consistency and availability, liveness and safety, durability, reliability, fault‑tolerance, consensus algorithms.
• Administrate cloud computing and CI/CD pipelines to include Azure, Google, and Amazon Web Service (AWS).
• Coordinate with stakeholders, including product, data and design teams to assist with data‑related technical issues and support their data infrastructure needs

Requirements

• Minimum of 1-year experience is required.
• Bachelor's degree in a STEM field with preference towards Computer Science and Software Engineering.
• Verifiable work experience working with data structures, database management, distributed computing, and API driven architectures using SQL and No‑SQL engines.
• Proficient in modelling frameworks like Universal Modeling Language (UML), Agile Development, and Git Operations.
• A Top Secret clearance with SCI eligibility is required.

Preferred Qualifications

• Familiarity with Palantir Foundry
• Familiarity with DoW

Salary Range: $77,000 - $180,000

We are an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or veteran status.

Create a Job Alert

Interested in building your career at Clarity Innovations? Get future opportunities sent straight to your email.