Data Engineer: Data Lake & Security Analytics (Onsite)

NeoMax; Herndon (VA); On-site; USD 150,000 - 210,000; Full time

Job summary

NeoMax in Herndon, VA is seeking a Data Engineer to support data integration and delivery in a security-focused environment. You will turn diverse inputs into reliable datasets for downstream IT and service delivery, on-site in Herndon.

Responsibilities include building a data lake, structuring unstructured data at load, and maintaining data standards while analyzing networks, systems, and log data. Strong Python and Bash scripting are required.

Qualifications

• 16+ years of experience.
• Bachelor’s or master’s degree.
• Experience integrating diverse data streams into a data lake.
• Experience with ETL and ensuring unstructured data is structured at time of load.
• Experience with data transfer tools such as NiFi and Cribl.
• Experience establishing data standards and serving as custodian for IT and service delivery data sets and streams.
• Experience analyzing complex networks and systems.
• Experience analyzing log data from various network components and operating systems.
• Knowledge of shared networks and multiple security enclaves.
• Systems Engineer with a Data Engineer background.
• Ability to manage and troubleshoot data feeds.
• Splunk CORE User certification prior to start.
• Splunk CORE Power User certification within 3 months from start.

Responsibilities

• Integrate diverse data streams into a data lake.
• Ensure unstructured data is structured at load.
• Establish data standards and custodian for IT/service delivery data sets and streams.
• Analyze complex networks and systems.
• Analyze log data from network components and operating systems.
• Manage and troubleshoot data feeds end-to-end.
• Use Python and Bash scripting to support data processing and automation.

Skills

Data integration

ETL

Python

BASH scripting

Splunk

Splunk CORE User

Splunk CORE Power User

Systems Engineer

Data lake

Data standards

Security enclaves

Network/log data analysis

Education

Bachelor’s or Master’s degree

Tools

NiFi

Cribl

AWS

Azure

Job description

NeoMax in Herndon, VA is seeking a Data Engineer to support data integration and delivery in a security-focused environment. You will turn diverse inputs into reliable datasets for downstream IT and service delivery, on-site in Herndon.

Responsibilities include building a data lake, structuring unstructured data at load, and maintaining data standards while analyzing networks, systems, and log data. Strong Python and Bash scripting are required.