Data Engineer

NeoMax; Herndon (VA); Presencial; USD 150 000 - 210 000; Tempo integral

Resumo da oferta

NeoMax in Herndon, VA is seeking a Data Engineer to support data integration and delivery in a security-focused environment. You will turn diverse inputs into reliable datasets for downstream IT and service delivery, on-site in Herndon.

Responsibilities include building a data lake, structuring unstructured data at load, and maintaining data standards while analyzing networks, systems, and log data. Strong Python and Bash scripting are required.

Qualificações

• 16+ years of experience.
• Bachelor’s or master’s degree.
• Experience integrating diverse data streams into a data lake.
• Experience with ETL and ensuring unstructured data is structured at time of load.
• Experience with data transfer tools such as NiFi and Cribl.
• Experience establishing data standards and serving as custodian for IT and service delivery data sets and streams.
• Experience analyzing complex networks and systems.
• Experience analyzing log data from various network components and operating systems.
• Knowledge of shared networks and multiple security enclaves.
• Systems Engineer with a Data Engineer background.
• Ability to manage and troubleshoot data feeds.
• Splunk CORE User certification prior to start.
• Splunk CORE Power User certification within 3 months from start.

Responsabilidades

• Integrate diverse data streams into a data lake.
• Ensure unstructured data is structured at load.
• Establish data standards and custodian for IT/service delivery data sets and streams.
• Analyze complex networks and systems.
• Analyze log data from network components and operating systems.
• Manage and troubleshoot data feeds end-to-end.
• Use Python and Bash scripting to support data processing and automation.

Conhecimentos

Data integration

ETL

Python

BASH scripting

Splunk

Splunk CORE User

Splunk CORE Power User

Systems Engineer

Data lake

Data standards

Security enclaves

Network/log data analysis

Formação académica

Bachelor’s or Master’s degree

Ferramentas

NiFi

Cribl

AWS

Azure

Descrição da oferta de emprego

NeoMax is hiring a Data Engineer to support data integration and delivery in a complex, security-focused environment in Herndon, VA (onsite). If you bring a Systems Engineer background alongside strong data engineering fundamentals, you will help turn diverse inputs into reliable datasets for downstream IT and service delivery use.

Responsibilities

• Integrate diverse data streams into a data lake.
• Ensure unstructured data is structured at time of load.
• Establish data standards and act as the custodian of IT and service delivery data sets and streams.
• Analyze complex networks and systems.
• Analyze log data from network components and operating systems.
• Manage and troubleshoot data feeds end-to-end.
• Use Python and BASH scripting to support data processing and automation.

Requirements

• 16+ years of experience.
• Bachelor’s or master’s degree.
• Experience integrating diverse data streams into a data lake.
• Experience with ETL and ensuring unstructured data is structured at time of load.
• Experience with data transfer tools such as NiFi and Cribl (examples provided).
• Experience establishing data standards and serving as custodian for IT and service delivery data sets and streams.
• Experience analyzing complex networks and systems.
• Experience analyzing log data from various network components and operating systems.
• Knowledge of complex environments involving shared networks and multiple security enclaves.
• Systems Engineer with a Data Engineer background.
• Ability to manage and troubleshoot data feeds.
• Splunk CORE User certification prior to start.
• Splunk CORE Power User certification within 3 months from start.

Technology Focus

Python, BASH scripting, NiFi, Cribl, Splunk, and ShellScript.

Desired Skills

• SecDevOps (Security Development and Operations)
• Hands-on Splunk experience and certifications
• Scripting tools such as Python, ShellScript, or Ansible
• Cloud security controls and implementation
• Public, private, and hybrid cloud experience (including AWS and Microsoft Azure)
• AWS Certified Security Specialty

Location: Herndon, VA (onsite)