Data Engineering Software Developer (Mid)

Amatriot Group, LLC; Washington (District of Columbia); On-site; USD 175,000 - 200,000; Full time

Job summary

Amatriot Group, LLC in Washington, DC is seeking a Mid Data Engineering Software Developer to design, build, and maintain scalable data pipelines supporting analytics and operations across enterprise environments. You will work with Confluent Kafka, Elastic Stack, AWS, and OpenShift/Kubernetes, develop data warehouses and data lakes, and collaborate across software, data, analytics, and network ops teams.

This role requires DoD/DISA compliance and TS/SCI clearance, with strong Python/Java/SQL

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical discipline, with 4–7 years of relevant experience.
• Hands-on experience designing, building, and maintaining ETL/ELT data pipelines.
• Experience with data warehouse and data lake technologies (AWS Redshift, S3, Hadoop, Snowflake or similar).
• Experience with Elastic Stack, Kafka, Linux/UNIX, and CI/CD pipelines.
• Strong knowledge of DoD/DISA security requirements.
• Proficiency with Python, Java, SQL, and shell scripting.

Responsibilities

• Design, build, and maintain scalable data systems and pipelines to ingest, process, and transform large data sources for analytics and reporting.
• Unify data from multiple network ops systems into a consistent platform.
• Develop and maintain ETL/ELT processes for ingestion, transformation, validation, and cleansing.
• Create and maintain Kafka, Elastic, and Logstash pipelines for enterprise data processing.
• Automate data-related processing and monitoring activities.
• Collaborate with data analysts, visualization engineers, and software developers to deliver integrated data solutions.

Skills

Python

Java

SQL

Shell scripting

Education

Bachelor’s degree in Computer Science, Engineering, or a related technical discipline

Tools

Elastic Stack

Kafka

AWS

OpenShift/Kubernetes

Linux/UNIX

CI/CD

Git

Bitbucket

Job description

Career Opportunities with Amatriot Group, LLC

A great place to work.

Share with friends or Subscribe!

Are you ready for new challenges and new opportunities?

Join our team!

Current job opportunities are posted here as they become available.

Subscribe to our RSS feeds to receive instant updates as new positions become available.

Data Engineering Software Developer (Mid)

Location: Washington, DC 100% Onsite
Clearance: Top Secret/SCI
Job Type: Full-time
Target Salary Range*:$175,000 - $200,000

*This represents the potential salary range for this position depending on education level, years of experience and/or certifications in addition to other position specific requirements which may impact salary

Position Overview

The Data Engineering Software Developer Mid designs, builds, integrates, and maintains scalable data systems and pipelines that support analytics, reporting, and operational insight across complex enterprise environments. This role focuses on ingesting, processing, transforming, and unifying large and disparate data sources while ensuring data quality, security, performance, and compliance with DoD and DISA requirements.

The Data Engineering Software Developer Mid develops solutions using Confluent Kafka, Elastic Stack, AWS, Red Hat OpenShift/Kubernetes, data warehouses, and data lakes. The position also supports automation, CI/CD, platform optimization, visualization capabilities, and collaboration across software, data, analytics, and network operations teams.

Key Responsibilities

Data Pipeline Development and Integration

• Design, build, and maintain scalable and reliable data systems and pipelines to ingest, process, and transform large, complex, and disparate data sources for analytics and reporting.
• Unify and integrate data from multiple network operations systems into a consistent and accessible platform.
• Develop and maintain ETL/ELT processes supporting data ingestion, transformation, validation, and cleansing.
• Create and maintain Kafka, Elastic, and Logstash pipelines supporting enterprise data processing requirements.
• Automate data-related processing and monitoring activities.

Data Platforms and Software Development

• Implement data solutions using Confluent Kafka, Elastic Stack, AWS, and Red Hat OpenShift/Kubernetes.
• Develop and manage data warehouses and data lakes supporting analytics, reporting, and operational dashboards.
• Develop data-engineering capabilities using Python, Java, SQL, shell scripting, and related technologies.
• Apply software engineering and automation practices to improve the maintainability and scalability of data solutions.

Performance and Platform Optimization

• Analyze and optimize data-ingestion throughput, query performance, indexing strategies, and storage efficiency across Elastic and Kafka platforms.
• Optimize infrastructure for performance, scalability, reliability, and cost effectiveness.
• Troubleshoot and resolve issues related to data ingestion, processing, storage, memory utilization, partitioning, and cluster performance.
• Identify and resolve performance bottlenecks affecting data availability and downstream analytics.

Security, Compliance, and DevOps

• Ensure data quality, accuracy, security, and compliance with applicable DoD and DISA requirements.
• Apply appropriate data security and access-control practices.
• Support CI/CD pipelines for automated build, test, and deployment activities.
• Apply version control and DevOps practices to data engineering and software development workflows.

Collaboration and Documentation

• Collaborate with data analysts, visualization engineers, software developers, and other stakeholders to deliver integrated and actionable data solutions.
• Document data architecture, integration patterns, configurations, and operational procedures.
• Develop and maintain technical documentation and runbooks supporting data platforms, pipelines, and applications.

Qualifications

Education

Bachelor’s degree in Computer Science, Engineering, or a related technical discipline with 4-7 years of relevant experience. [Required]

Experience

• Hands-on experience designing, building, and maintaining ETL/ELT data pipelines and integrating multiple disparate data sources. [Required]
• Experience with data warehouse and/or data lake technologies such as AWS Redshift, Amazon S3, Hadoop, Snowflake, or similar platforms. [Required]
• Experience with Elastic Stack, including Elasticsearch, Logstash, and Kibana, and/or Kafka for data ingestion and processing. [Required]
• Experience with Linux/UNIX system administration and automation. [Required]
• Experience with CI/CD pipelines, containerized pipelines, version control technologies such as Git and Bitbucket, and DevOps practices. [Required]
• Familiarity with network operations data, including logs, metrics, events, ticketing, CMDB data, and related data models.

Skills

• Proficiency with data engineering and software development technologies and languages such as Python, Java, SQL, and shell scripting. [Required]
• Knowledge of data security, access controls, and compliance frameworks, including DoD, DISA, RMF, and STIG requirements. [Required]
• Strong communication and documentation skills supporting collaboration and knowledge sharing. [Required]

Certifications

Current Security+ certification or higher/equivalent certification. [Required]

Clearance

Active TS/SCI security clearance. [Required]

Other Requirements

Willingness and ability to complete and maintain additional customer suitability screenings throughout employment. [Required]

Preferred Qualifications

• Experience supporting DISA, DISN, or other DoD network environments.
• Experience developing and deploying software applications that meet DoD security standards, including applicable STIGs.
• Knowledge of network security, encryption, and access controls within classified environments.
• Experience with big data technologies and platforms such as Kafka, Spark, NiFi, Hadoop, Elasticsearch, Logstash, Databricks, and ELK Stack.
• Experience applying big data technologies to text mining, summarization, search, and entity extraction.
• Experience with cloud-based data platforms, including AWS, Azure, GCP, or AWS GovCloud.
• Experience with cloud-integrated platforms and Infrastructure as Code, including networking and security policies.
• Familiarity with Kubernetes deployment, platform upgrades, and patching.
• Experience with configuration management technologies such as Ansible, Puppet, or Chef.
• Experience with monitoring, alerting, and observability technologies such as Prometheus, Grafana, and Elastic.
• Experience with business intelligence and visualization tools such as Kibana.
• Experience developing and maintaining technical documentation and operational runbooks.
• Strong understanding and practical experience with Agile methodologies, including Scrum and SAFe.
• Experience with Atlassian Jira and Confluence.
• Elastic Certified Engineer certification.
• Experience working remotely with geographically dispersed teams and within matrixed organizations.
• Experience combining software development, integration, and data engineering practices.
• Experience applying knowledge of system architecture, networking, and centralized logging using ELK to support data transformation initiatives.