Data Engineer w/ Accumulo (MUST have DoD Clearance)

Sandtechsolutions; San Antonio (TX); On-site; USD 110,000 - 140,000; Full time

Job summary

Sandoval Technology Solutions LLC is seeking a Data Engineer with DoD clearance to design, build, and optimize data pipelines using NiFi, Hadoop, Accumulo, and Elasticsearch. You will develop RESTful APIs, manage data storage, and collaborate with cross-functional teams to meet security and compliance requirements.

The ideal candidate will have a strong background in data integration and processing, experience with distributed storage systems, and proficiency in Python, Java, or Scala.

Qualifications

• Bachelor's degree in CS/IT or related field.
• Experience as Data Engineer with complex data environments.
• Proficiency in Apache NiFi for data integration.
• Experience developing and managing RESTful APIs.

Responsibilities

• Design, develop, and maintain data pipelines for deployments.
• Use Apache NiFi for data ingestion, transformation, and routing.
• Develop and maintain RESTful APIs for data exchange.
• Manage data storage with Hadoop, Accumulo, and Elasticsearch.
• Collaborate with cross-functional teams to meet data requirements.
• Ensure data quality, integrity, and security across the lifecycle.
• Monitor data workflows for performance and reliability.
• Troubleshoot data integration issues and optimizations.

Skills

Data integration

Data processing

RESTful APIs

Python

Java

Scala

Data security

Communication

Education

Bachelor's degree in CS/IT or related field

Tools

Apache NiFi

Hadoop

Accumulo

Elasticsearch

Docker

Kubernetes

AWS

Azure

Google Cloud

Job description

Career Opportunities with Sandoval Technology Solutions LLC

A great place to work.

Careers At Sandoval Technology Solutions LLC

Current job opportunities are posted here as they become available.

Subscribe to our RSS feeds to receive instant updates as new positions become available.

Data Engineer w/ Accumulo (MUST have DoD Clearance)

The ideal candidate will have extensive experience with data integration, processing, and management, specifically utilizing Apache Nifi, RESTful APIs, Hadoop, Accumulo, and Elasticsearch.

Key Responsibilities:

• Design, develop, and maintain data pipelines to support C2IE deployments.
• Utilize Apache NiFi for data ingestion, transformation, and routing.
• Develop and maintain RESTful APIs for seamless data exchange between systems.
• Implement and manage data storage solutions, including Hadoop, Accumulo, and Elasticsearch.
• Collaborate with cross-functional teams to understand data requirements and implement effective solutions.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Monitor and optimize data workflows to ensure high performance and reliability.
• Troubleshoot and resolve issues related to data integration and processing.
• Stay updated with the latest trends and technologies in data engineering and apply them to improve existing processes.

Required Skills and Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or related field.
• Proven experience as a Data Engineer or similar role, with a focus on supporting complex data environments.
• Strong proficiency in Apache NiFi for data integration and processing.
• Experience in developing and managing RESTful APIs.
• In-depth knowledge of data storage solutions, including Hadoop, Accumulo, and Elasticsearch.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong understanding of data security and compliance requirements.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Preferred Qualifications:

• Experience with Elastic Search and the Elastic Stack
• Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) for data engineering.
• Knowledge of DevOps practices and tools like Jenkins, Docker, and Kubernetes.
• Experience with data visualization tools and techniques.
• Relevant certifications in data engineering or related fields.