Cleared Hybrid Data Engineer (5418)

SMX; Town of Hanover (NY); On-site; USD 103,000 - 172,000; Full time

Benefits offered by this job

Health insurance

Retirement

Paid leave

Job summary

SMX is seeking a Data Engineer to design, build, and maintain scalable data architectures powering AI, analytics, and reporting. You will transform raw, unstructured data into high-quality pipelines, collaborating with Analysts, AI Engineers, and Software Engineers across cloud and on-prem environments.

The role emphasizes data reliability, performance, and secure, governed datasets for enterprise-wide use, involving cross-team partnerships and production-ready data delivery.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Data Engineering.

Responsibilities

• Design, construct, install, test, and maintain scalable data management systems and robust ELT/ETL pipelines across cloud and on-prem systems.
• Build infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using cloud technologies.
• Implement monitoring systems to ensure data integrity, quality, and security across all storage and processing layers. Implement data quality checks, validation, lineage tracking, and metadata management.
• Prepare and optimize data for AI/ML models, semantic search, analytics, and mission applications.
• Identify, design, and implement internal process improvements, such as automating manual processes and optimizing data delivery for greater scalability. Automate ingestion and transformation processes using industry-standard tools and patterns. Troubleshoot pipeline issues and optimize for performance and cost.
• Work with analytics and business teams to understand their data requirements and deliver production-ready datasets. Collaborate with AI engineers and analysts to ensure datasets meet requirements.

Skills

Python

SQL

Java

Data modeling

Security clearance

Education

Bachelor's degree in Computer Science, Information Technology, Data Engineering

Tools

Snowflake

AWS Redshift

Spark

Databricks

Kafka

Azure Data Factory

AWS Glue

Apache Airflow

AWS

GCP

Azure

Job description

SMX is hiring a Data Engineer responsible for designing, building, and maintaining scalable data architecture that powers our AI, analytics and reporting. Collaborate closely with Analysts, AI Engineers, and Software Engineers to transform raw, unstructured data into high-quality, accessible data pipelines. Optimizing data systems, building them from the ground up, and ensuring peak data reliability and performance. This role is essential for making data accessible, reliable, and usable across the enterprise.

Essential Duties and Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and robust ELT/ETL pipelines across cloud and on-prem systems.
• Build infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using cloud technologies. Support API strategy, data modeling, and domain-driven data structures.
• Implement monitoring systems to ensure data integrity, quality, and security across all storage and processing layers. Implement data quality checks, validation, lineage tracking, and metadata management.
• Prepare and optimize data for AI/ML models, semantic search, analytics, and mission applications.
• Identify, design, and implement internal process improvements, such as automating manual processes and optimizing data delivery for greater scalability. Automate ingestion and transformation processes using industry-standard tools and patterns. Troubleshoot pipeline issues and optimize for performance and cost.
• Work with analytics and business teams to understand their data requirements and deliver production-ready datasets. Collaborate with AI engineers and analysts to ensure datasets meet requirements.

Required Skills & Experience

• Bachelor’s degree in Computer Science, Information Technology, Data Engineering
• 4+ years of progressive professional experience in a data engineering or backend software engineering role
• Security clearance required (Secret or higher)
• Strong proficiency in Python, SQL, Java.
• Experience with cloud data warehouses such as Snowflake and AWS Redshift.
• Familiarity with distributed computing tools like Spark, Databricks, and Kafka.
• Experience with Azure Data Factory, AWS Glue, or similar data integration platforms.
• Experience with workflow management tools like Apache Airflow.
• Hands-on experience with AWS, GCP, or Azure cloud environments. Familiarity with multi-cloud data ecosystem patterns.
• Experience integrating structured and unstructured data sources. Knowledge of schema design, data modeling, and cloud-based storage patterns.

Desired Skills & Experience

• Experience supporting AI/ML pipelines, vectorization, or embedding generation
• Experience with data governance, access controls, or sensitive data protection
• Exposure to DevOps/CI-CD patterns for data workflows
• MuleSoft implementation experience
• Experience with real-time data streaming and event-driven architectures

The SMX salary determination process takes into account a number of factors, including but not limited to, geographic location, Federal Government contract labor categories, relevant prior work experience, specific skills, education and certifications. At SMX, one of our Core Values is to Invest in Our People so we offer a competitive mix of compensation, learning & development opportunities, and benefits. Some key components of our robust benefits include health insurance, paid leave, and retirement.

The proposed salary for this position is:

$103,000—$171,800 USD

At SMX®, we are a team of technical and domain experts dedicated to enabling your mission. From priority national security initiatives for the DoD to highly assured and compliant solutions for healthcare, we understand that digital transformation is key to your future success.

We share your vision for the future and strive to accelerate your impact on the world. We bring both cutting edge technology and an expansive view of what’s possible to every engagement. Our delivery model and unique approaches harness our deep technical and domain knowledge, providing forward-looking insights and practical solutions to power secure mission acceleration.

SMX is an Equal Opportunity employer including disabilities and veterans.

Selected applicant may be subject to a background investigation and/or education verification.

SMX does not sponsor a new applicant for employment authorization or immigration related support for this position (i.e. H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).